Jul 07 21:45:16 devstack cinder-volume[76278]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 21:45:16 devstack cinder-volume[76278]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 21:45:16 devstack cinder-volume[76278]: we strongly recommend against using it for new projects. Jul 07 21:45:16 devstack cinder-volume[76278]: If you are already using Eventlet, we recommend migrating to a different Jul 07 21:45:16 devstack cinder-volume[76278]: framework. For more detail see Jul 07 21:45:16 devstack cinder-volume[76278]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 21:45:16 devstack cinder-volume[76278]: import eventlet # noqa Jul 07 21:45:19 devstack cinder-volume[76278]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76278) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 21:45:19 devstack cinder-volume[76278]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76278) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 21:45:19 devstack cinder-volume[76278]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76278) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 21:45:20 devstack cinder-volume[76278]: INFO dbcounter [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Registered counter for database cinder Jul 07 21:45:20 devstack cinder-volume[76278]: DEBUG oslo_db.sqlalchemy.engines [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76278) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 21:45:20 devstack cinder-volume[76278]: DEBUG dbcounter [-] [76278] Writer thread running {{(pid=76278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 21:45:20 devstack cinder-volume[76278]: INFO cinder.rpc [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 21:45:20 devstack cinder-volume[76278]: INFO cinder.rpc [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 21:45:20 devstack cinder-volume[76278]: DEBUG oslo_db.sqlalchemy.engines [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76278) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 21:45:20 devstack cinder-volume[76278]: INFO cinder.volume.manager [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Determined volume DB was empty at startup. Jul 07 21:45:20 devstack cinder-volume[76278]: DEBUG cinder.volume.manager [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76278) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 21:45:20 devstack cinder-volume[76278]: INFO cinder.volume.manager [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 21:45:20 devstack cinder-volume[76278]: WARNING stevedore.named [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 21:45:20 devstack cinder-volume[76278]: WARNING castellan.key_manager [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 21:45:20 devstack cinder-volume[76278]: WARNING cinder.keymgr.conf_key_mgr [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 21:45:20 devstack cinder-volume[76278]: DEBUG cinder.volume.drivers.lvm [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76278) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 07 21:45:20 devstack cinder-volume[76278]: DEBUG oslo_concurrency.processutils [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_concurrency.processutils [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] CMD "cinder-rtstool verify" returned: 0 in 0.394s {{(pid=76278) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_db.sqlalchemy.engines [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76278) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 21:45:21 devstack cinder-volume[76278]: INFO cinder.rpc [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 07 21:45:21 devstack cinder-volume[76278]: INFO cinder.rpc [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 07 21:45:21 devstack cinder-volume[76278]: WARNING stevedore.named [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 21:45:21 devstack cinder-volume[76278]: WARNING castellan.key_manager [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 21:45:21 devstack cinder-volume[76278]: INFO cinder.volume.manager [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_db.sqlalchemy.engines [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76278) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 21:45:21 devstack cinder-volume[76278]: INFO oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Starting 1 workers Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Started child 76496 {{(pid=76278) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 21:45:21 devstack cinder-volume[76496]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Full set of CONF: {{(pid=76278) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] ******************************************************************************** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Configuration options gathered from: {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] ================================================================================ {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] allow_availability_zone_fallback = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] allow_compression_on_image_upload = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] allowed_direct_url_schemes = [] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] api_rate_limit = True {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] auth_strategy = keystone {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] az_cache_duration = 3600 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_availability_zone = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_host = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_name = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_stats_polling_interval = 60 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backup_api_class = cinder.backup.api.API {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backup_name_template = backup-%s {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backup_use_same_host = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backup_use_temp_snapshot = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] chap_password = **** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] chap_username = {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cinder_internal_tenant_project_id = 7f5c4dcdd0564605927fbcd21569966e {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cinder_internal_tenant_user_id = 178000ca047b4ff1be6359d2f32d6a4c {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cloned_volume_same_az = True {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cluster = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] compression_format = gzip {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] compute_api_class = cinder.compute.nova.API {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] config_dir = [] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] config_source = [] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] control_exchange = openstack {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] debug = True {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] default_availability_zone = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] default_group_type = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] default_volume_type = lvmdriver-1 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] disk_geometry = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] driver_client_cert = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] driver_client_cert_key = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] driver_data_namespace = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] driver_ssl_cert_path = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] driver_ssl_cert_verify = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] driver_use_ssl = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] enable_force_upload = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] enable_new_services = True {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] enable_unsupported_driver = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] enabled_backends = ['lvmdriver-1'] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] enforce_multipath_for_image_xfer = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] filter_function = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] glance_api_insecure = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] glance_api_servers = ['http://192.168.122.248/image'] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] glance_api_ssl_compression = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] glance_ca_certificates_file = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] glance_catalog_info = image:glance:publicURL {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] glance_certfile = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] glance_keyfile = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] glance_num_retries = 3 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] glance_request_timeout = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] goodness_function = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] graceful_shutdown_timeout = 5 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] group_api_class = cinder.group.api.API {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] host = devstack {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] image_compress_on_upload = True {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] image_conversion_address_space_limit = 1 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] image_conversion_cpu_limit = 60 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] image_conversion_disable = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] image_upload_use_cinder_backend = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] image_upload_use_internal_tenant = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] image_volume_cache_enabled = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] image_volume_cache_max_count = 0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] image_volume_cache_max_size_gb = 0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] init_host_max_objects_retrieval = 0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack sudo[76504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 07 21:45:21 devstack cinder-volume[76496]: INFO cinder.volume.manager [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 07 21:45:21 devstack sudo[76504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] instance_format = [instance: %(uuid)s] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] iscsi_target_flags = {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] iscsi_write_cache = on {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] iser_helper = tgtadm {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] iser_ip_address = 192.168.122.248 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] iser_port = 3260 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] log_color = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] log_config_append = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] log_dir = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] log_file = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] log_options = True {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] log_rotate_interval = 1 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] log_rotate_interval_type = days {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] log_rotation_type = none {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:21 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] max_age = 0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] max_logfile_count = 30 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] max_logfile_size_mb = 200 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] max_over_subscription_ratio = 20.0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] message_reap_interval = 86400 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] message_ttl = 2592000 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] migration_create_volume_timeout_secs = 300 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] monkey_patch = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] monkey_patch_modules = [] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] my_ip = 192.168.122.248 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] no_snapshot_gb_quota = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] num_iser_scan_tries = 3 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] num_shell_tries = 3 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] num_volume_device_scan_tries = 3 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] nvmeof_conn_info_version = 1 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] nvmet_ns_id = 10 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] nvmet_port_id = 1 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] osapi_max_limit = 1000 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] osapi_volume_ext_list = [] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] osapi_volume_listen = 0.0.0.0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] osapi_volume_listen_port = 8776 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] osapi_volume_use_ssl = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] osapi_volume_workers = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] per_volume_size_limit = -1 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] periodic_fuzzy_delay = 60 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] periodic_interval = 60 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] project_id_regex = [0-9a-f\-]+ {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] public_endpoint = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] publish_errors = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] quota_backup_gigabytes = 1000 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] quota_backups = 10 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] quota_gigabytes = 1000 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] quota_groups = 10 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] quota_snapshots = 10 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] quota_volumes = 10 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] rate_limit_burst = 0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] rate_limit_except_level = CRITICAL {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] rate_limit_interval = 0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] reinit_driver_count = 3 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] replication_device = **** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] report_discard_supported = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] report_interval = 120 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] reservation_clean_interval = 86400 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] reservation_expire = 86400 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] reserved_image_namespaces = [] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] reserved_percentage = 0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] rpc_response_timeout = 120 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] run_external_periodic_tasks = True {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] scst_target_driver = iscsi {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] scst_target_iqn_name = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] service_down_time = 720 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] shell_completion = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] snapshot_name_template = snapshot-%s {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] snapshot_same_host = True {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] split_loggers = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] state_path = /opt/stack/data/cinder {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] storage_availability_zone = nova {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] storage_protocol = iSCSI {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] syslog_log_facility = LOG_USER {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] target_helper = lioadm {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] target_ip_address = 192.168.122.248 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] target_port = 3260 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] target_protocol = iscsi {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] target_secondary_ip_addresses = [] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] trace_flags = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] transfer_api_class = cinder.transfer.api.API {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] transport_url = **** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.085s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:22 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] until_refresh = 0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] use_chap_auth = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] use_default_quota_class = True {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] use_journal = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] use_json = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] use_multipath_for_image_xfer = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] use_stderr = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] use_syslog = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] verify_glance_signatures = enabled {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] volume_api_class = cinder.volume.api.API {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] volume_backend_name = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] volume_clear = zero {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] volume_clear_ionice = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] volume_clear_size = 0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] volume_copy_bps_limit = 0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] volume_dd_blocksize = 1M {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] volume_name_template = volume-%s {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] volume_service_inithost_offload = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] volume_usage_audit_period = month {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] zoning_mode = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_concurrency.disable_process_locking = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.auth_section = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.auth_type = password {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.auth_version = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.cache = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.certfile = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.delay_auth_decision = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.http_connect_timeout = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.include_service_catalog = True {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.insecure = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.interface = public {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.keyfile = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.memcache_password = {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.memcache_username = {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.region_name = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.service_token_roles_required = True {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.service_type = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.token_cache_time = 300 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.248/identity {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.backend = dogpile.cache.null {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.backend_argument = **** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.backend_expiration_time = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.config_prefix = cache.oslo {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.debug_cache_backend = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.enable_retry_client = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.enable_socket_keepalive = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.enabled = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.expiration_time = 600 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.hashclient_retry_attempts = 2 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.memcache_dead_retry = 300 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.memcache_pool_maxsize = 10 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.memcache_sasl_enabled = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.password = **** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.proxies = [] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.redis_db = 0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.redis_sentinel_service_name = mymaster {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.redis_server = localhost:6379 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.retry_attempts = 2 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.retry_delay = 0.0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.socket_keepalive_count = 1 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.socket_keepalive_idle = 1 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.socket_keepalive_interval = 1 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.060s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:22 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.socket_timeout = 1.0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.tls_allowed_ciphers = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.tls_cafile = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.tls_certfile = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.tls_enabled = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.tls_keyfile = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cache.username = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] coordination.backend_url = **** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.asyncio_connection = **** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.asyncio_slave_connection = **** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.backend = sqlalchemy {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.connection = **** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.connection_debug = 0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.connection_parameters = {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.connection_recycle_time = 3600 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.connection_trace = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.db_inc_retry_interval = True {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.db_max_retries = 20 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.db_max_retry_interval = 10 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.db_retry_interval = 1 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.max_overflow = 50 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.max_pool_size = 5 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.max_retries = 10 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.mysql_wsrep_sync_wait = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.pool_timeout = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.retry_interval = 10 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.slave_connection = **** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.sqlite_synchronous = True {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.synchronous_reader = True {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] database.use_db_reconnect = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] profiler.connection_string = messaging:// {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] profiler.enabled = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] profiler.es_doc_type = notification {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] profiler.es_scroll_size = 10000 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] profiler.es_scroll_time = 2m {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] profiler.filter_error_trace = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] profiler.hmac_keys = **** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] profiler.sentinel_service_name = mymaster {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] profiler.socket_timeout = 0.1 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] profiler.trace_requests = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] profiler.trace_sqlalchemy = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] profiler_jaeger.process_tags = {} {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] profiler_jaeger.service_name_prefix = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] profiler_otlp.service_name_prefix = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_policy.enforce_new_defaults = True {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_policy.enforce_scope = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_policy.policy_default_rule = default {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_policy.policy_file = policy.yaml {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_policy.remote_timeout = 60.0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] privsep_osbrick.group = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] privsep_osbrick.helper_command = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] privsep_osbrick.user = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cinder_sys_admin.group = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cinder_sys_admin.helper_command = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] cinder_sys_admin.user = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] service_user.auth_section = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] service_user.auth_type = password {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] service_user.cafile = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] service_user.certfile = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] service_user.collect_timing = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] service_user.insecure = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] service_user.keyfile = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] service_user.send_service_user_token = True {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] service_user.split_loggers = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] service_user.timeout = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] glance.auth_section = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] glance.auth_type = password {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] glance.certfile = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] glance.collect_timing = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] glance.insecure = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] glance.keyfile = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] glance.region_name = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] glance.split_loggers = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] glance.timeout = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.backend_availability_zone = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.chap_password = **** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.chap_username = {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.disk_geometry = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.driver_client_cert = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.driver_client_cert_key = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.driver_data_namespace = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.driver_use_ssl = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.enable_unsupported_driver = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.extra_capabilities = {} {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.filter_function = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.goodness_function = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.iscsi_target_flags = {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:22 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.iscsi_write_cache = on {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.iser_helper = tgtadm {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.iser_ip_address = 192.168.122.248 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.iser_port = 3260 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.lvm_mirrors = 0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.lvm_share_target = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.lvm_type = auto {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.num_shell_tries = 3 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.nvmet_port_id = 1 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.replication_device = **** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.report_discard_supported = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.reserved_percentage = 0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.scst_target_driver = iscsi {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.scst_target_iqn_name = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.storage_protocol = iSCSI {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.target_helper = tgtadm {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.target_ip_address = 192.168.122.248 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.target_port = 3260 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.target_protocol = iscsi {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.trace_flags = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.unique_fqdn_network = True {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.use_chap_auth = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.volume_backend_name = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.volume_clear = zero {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.volume_clear_ionice = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.volume_clear_size = 0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.volume_group = cinder-volumes {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_reports.file_event_handler = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_reports.log_dir = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.backend_availability_zone = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.backend_host = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.chap_password = **** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.chap_username = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.chiscsi_conf = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.disk_geometry = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.driver_client_cert = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.driver_data_namespace = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.driver_use_ssl = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.extra_capabilities = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.filter_function = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.goodness_function = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.iser_helper = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.iser_ip_address = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.iser_port = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.iser_target_prefix = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.lvm_conf_file = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.lvm_mirrors = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.lvm_share_target = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.lvm_type = auto {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.num_shell_tries = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.nvmet_port_id = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.replication_device = **** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.report_discard_supported = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.reserved_percentage = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.scst_target_driver = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.storage_protocol = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.target_helper = lioadm {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.target_ip_address = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.target_port = 3260 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.target_protocol = iscsi {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.trace_flags = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.use_chap_auth = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.volume_clear = zero {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.volume_clear_size = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] lvmdriver-1.volumes_dir = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.ssl = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.ssl_version = {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_notifications.driver = [] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_notifications.retry = -1 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] oslo_messaging_notifications.transport_url = **** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] key_manager.fixed_key = **** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican.barbican_api_version = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican.barbican_endpoint = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican.barbican_endpoint_type = public {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican.barbican_region_name = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican.cafile = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican.certfile = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican.collect_timing = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican.insecure = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican.keyfile = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican.number_of_retries = 60 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican.retry_delay = 1 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican.send_service_user_token = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican.split_loggers = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican.timeout = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican.verify_ssl = True {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican.verify_ssl_path = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican_service_user.auth_section = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican_service_user.auth_type = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican_service_user.cafile = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican_service_user.certfile = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican_service_user.collect_timing = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican_service_user.insecure = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican_service_user.keyfile = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican_service_user.split_loggers = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] barbican_service_user.timeout = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] vault.approle_role_id = **** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] vault.approle_secret_id = **** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] vault.kv_mountpoint = secret {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] vault.kv_path = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] vault.kv_version = 2 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] vault.namespace = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] vault.root_token_id = **** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] vault.ssl_ca_crt_file = None {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] vault.timeout = 60.0 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] vault.use_ssl = False {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack sudo[76504]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:45:22 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] ******************************************************************************** {{(pid=76278) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 21:45:22 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.882s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:22 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:22 devstack sudo[76753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 21:45:22 devstack sudo[76753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:23 devstack sudo[76753]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:23 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.636s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:23 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 21:45:23 devstack cinder-volume[76496]: INFO cinder.brick.local_dev.lvm [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 07 21:45:23 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:23 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:23 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:23 devstack sudo[76984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 21:45:23 devstack sudo[76984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:24 devstack sudo[76984]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:24 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.777s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:24 devstack cinder-volume[76496]: DEBUG cinder.brick.local_dev.lvm [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76496) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 07 21:45:24 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:24 devstack sudo[77149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 21:45:24 devstack sudo[77149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:25 devstack sudo[77149]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:25 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.098s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:25 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:25 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:25 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:25 devstack sudo[77277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 21:45:25 devstack sudo[77277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:26 devstack sudo[77277]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:26 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.737s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:26 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:26 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:26 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:26 devstack sudo[77283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 07 21:45:26 devstack sudo[77283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:26 devstack sudo[77283]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:26 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.704s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:26 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:26 devstack sudo[77287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 21:45:26 devstack sudo[77287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:27 devstack sudo[77287]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:27 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.753s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:27 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:27 devstack sudo[77294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 21:45:27 devstack sudo[77294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:28 devstack sudo[77294]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:28 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.953s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:28 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:28 devstack sudo[77305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 21:45:28 devstack sudo[77305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:29 devstack sudo[77305]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:29 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.684s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:29 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:29 devstack sudo[77309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 21:45:29 devstack sudo[77309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:30 devstack sudo[77309]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:30 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.069s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:30 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:30 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:30 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:30 devstack sudo[77318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 21:45:30 devstack sudo[77318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:31 devstack sudo[77318]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:31 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.956s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:31 devstack cinder-volume[76496]: INFO cinder.volume.drivers.lvm [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 07 21:45:31 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:31 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:31 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:31 devstack sudo[77440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 21:45:31 devstack sudo[77440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:31 devstack cinder-volume[76278]: DEBUG dbcounter [-] [76278] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76278) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:45:31 devstack sudo[77440]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:31 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.664s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:31 devstack cinder-volume[76496]: DEBUG cinder.volume.drivers.lvm [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Updating volume stats {{(pid=76496) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 21:45:31 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:31 devstack sudo[77448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 21:45:31 devstack sudo[77448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:32 devstack sudo[77448]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:32 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.716s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:32 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:32 devstack sudo[77451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 21:45:32 devstack sudo[77451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:33 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:33 devstack sudo[77451]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:33 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:33 devstack sudo[77454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 21:45:33 devstack sudo[77454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:33 devstack sudo[77454]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:33 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.717s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:33 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:34 devstack sudo[77457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 21:45:34 devstack sudo[77457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:34 devstack sudo[77457]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:34 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.893s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:34 devstack cinder-volume[76496]: INFO cinder.volume.driver [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Driver hasn't implemented _init_vendor_properties() Jul 07 21:45:34 devstack cinder-volume[76496]: DEBUG cinder.volume.driver [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76496) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 21:45:34 devstack cinder-volume[76496]: DEBUG oslo_db.sqlalchemy.engines [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76496) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 21:45:34 devstack cinder-volume[76496]: DEBUG dbcounter [-] [76496] Writer thread running {{(pid=76496) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 21:45:34 devstack cinder-volume[76496]: DEBUG cinder.db.api [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Building query based on filter {{(pid=76496) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 21:45:35 devstack cinder-volume[76496]: DEBUG cinder.image.image_utils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76496) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 21:45:35 devstack cinder-volume[76496]: INFO cinder.keymgr.migration [None req-0a715e93-e3c4-4e40-a04b-9432896a471b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 21:45:35 devstack cinder-volume[76496]: DEBUG cinder.volume.drivers.lvm [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Updating volume stats {{(pid=76496) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 21:45:35 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:35 devstack sudo[77464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 21:45:35 devstack sudo[77464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:35 devstack sudo[77464]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:35 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:35 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:35 devstack sudo[77468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 21:45:35 devstack sudo[77468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:36 devstack sudo[77468]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:36 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:36 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:36 devstack sudo[77471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 21:45:36 devstack sudo[77471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:37 devstack sudo[77471]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:37 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.711s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:37 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:37 devstack sudo[77474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 21:45:37 devstack sudo[77474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:37 devstack sudo[77474]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:37 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:37 devstack cinder-volume[76496]: DEBUG cinder.manager [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Notifying Schedulers of capabilities ... {{(pid=76496) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:45:37 devstack cinder-volume[76496]: INFO cinder.volume.manager [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Driver initialization completed successfully. Jul 07 21:45:37 devstack cinder-volume[76496]: INFO cinder.manager [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Initiating service 2 cleanup Jul 07 21:45:37 devstack cinder-volume[76496]: INFO cinder.manager [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Service 2 cleanup completed. Jul 07 21:45:37 devstack cinder-volume[76496]: DEBUG cinder.service [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Creating RPC server for service cinder-volume {{(pid=76496) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 21:45:37 devstack cinder-volume[76496]: DEBUG cinder.service [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76496) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 21:45:37 devstack cinder-volume[76496]: INFO cinder.volume.manager [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 07 21:45:37 devstack cinder-volume[76496]: DEBUG cinder.volume.drivers.lvm [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Updating volume stats {{(pid=76496) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 21:45:37 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:37 devstack sudo[77477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 21:45:37 devstack sudo[77477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:38 devstack sudo[77477]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:38 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:38 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:38 devstack sudo[77483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 21:45:38 devstack sudo[77483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:39 devstack sudo[77483]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:39 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:39 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:39 devstack sudo[77486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 21:45:39 devstack sudo[77486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:39 devstack sudo[77486]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:39 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.686s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:39 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:45:39 devstack sudo[77489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 21:45:39 devstack sudo[77489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:45:40 devstack sudo[77489]: pam_unix(sudo:session): session closed for user root Jul 07 21:45:40 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:45:40 devstack cinder-volume[76496]: INFO cinder.volume.manager [None req-c85a1234-1c3d-476b-bebc-10ffc1eb33dd None None] Driver post RPC initialization completed successfully. Jul 07 21:45:50 devstack cinder-volume[76496]: DEBUG dbcounter [-] [76496] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76496) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:45:50 devstack cinder-volume[76496]: DEBUG dbcounter [-] [76496] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76496) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:45:56 devstack cinder-volume[76496]: DEBUG oslo_service.periodic_task [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running periodic task VolumeManager._thread_info {{(pid=76496) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:45:56 devstack cinder-volume[76496]: DEBUG cinder.volume.manager [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] thread count: 6 {{(pid=76496) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 21:45:56 devstack cinder-volume[76496]: DEBUG cinder.volume.manager [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] thread info: [<_MainThread(MainThread, started 123439672811648)>, , , , , ] {{(pid=76496) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 21:46:56 devstack cinder-volume[76496]: DEBUG oslo_service.periodic_task [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76496) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:46:56 devstack cinder-volume[76496]: DEBUG cinder.volume.drivers.lvm [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Updating volume stats {{(pid=76496) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 21:46:56 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:46:56 devstack sudo[78680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 21:46:56 devstack sudo[78680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:46:57 devstack sudo[78680]: pam_unix(sudo:session): session closed for user root Jul 07 21:46:57 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.712s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:46:57 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:46:57 devstack sudo[78683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 21:46:57 devstack sudo[78683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:46:58 devstack sudo[78683]: pam_unix(sudo:session): session closed for user root Jul 07 21:46:58 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.693s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:46:58 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:46:58 devstack sudo[78686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 21:46:58 devstack sudo[78686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:46:58 devstack sudo[78686]: pam_unix(sudo:session): session closed for user root Jul 07 21:46:58 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.769s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:46:58 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:46:58 devstack sudo[78989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 21:46:58 devstack sudo[78989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:46:59 devstack sudo[78989]: pam_unix(sudo:session): session closed for user root Jul 07 21:46:59 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.717s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:46:59 devstack cinder-volume[76496]: DEBUG cinder.manager [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Notifying Schedulers of capabilities ... {{(pid=76496) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:46:59 devstack cinder-volume[76496]: DEBUG oslo_service.periodic_task [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running periodic task VolumeManager._thread_info {{(pid=76496) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:46:59 devstack cinder-volume[76496]: DEBUG cinder.volume.manager [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] thread count: 6 {{(pid=76496) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 21:46:59 devstack cinder-volume[76496]: DEBUG cinder.volume.manager [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] thread info: [<_MainThread(MainThread, started 123439672811648)>, , , , , ] {{(pid=76496) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 21:47:50 devstack cinder-volume[76496]: DEBUG dbcounter [-] [76496] Writing DB stats cinder:SELECT=1 {{(pid=76496) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:47:50 devstack cinder-volume[76496]: DEBUG dbcounter [-] [76496] Writing DB stats cinder:UPDATE=1 {{(pid=76496) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:47:56 devstack cinder-volume[76496]: DEBUG oslo_service.periodic_task [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76496) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:47:56 devstack cinder-volume[76496]: DEBUG cinder.volume.drivers.lvm [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Updating volume stats {{(pid=76496) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 21:47:56 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:47:56 devstack sudo[80077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 21:47:56 devstack sudo[80077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:47:57 devstack sudo[80077]: pam_unix(sudo:session): session closed for user root Jul 07 21:47:57 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.687s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:47:57 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:47:57 devstack sudo[80080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 21:47:57 devstack sudo[80080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:47:57 devstack sudo[80080]: pam_unix(sudo:session): session closed for user root Jul 07 21:47:57 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.693s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:47:57 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:47:58 devstack sudo[80083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 21:47:58 devstack sudo[80083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:47:58 devstack sudo[80083]: pam_unix(sudo:session): session closed for user root Jul 07 21:47:58 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.674s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:47:58 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:47:58 devstack sudo[80086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 21:47:58 devstack sudo[80086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:47:59 devstack sudo[80086]: pam_unix(sudo:session): session closed for user root Jul 07 21:47:59 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:47:59 devstack cinder-volume[76496]: DEBUG cinder.manager [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Notifying Schedulers of capabilities ... {{(pid=76496) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:47:59 devstack cinder-volume[76496]: DEBUG oslo_service.periodic_task [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running periodic task VolumeManager._thread_info {{(pid=76496) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:47:59 devstack cinder-volume[76496]: DEBUG cinder.volume.manager [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] thread count: 6 {{(pid=76496) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 21:47:59 devstack cinder-volume[76496]: DEBUG cinder.volume.manager [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] thread info: [<_MainThread(MainThread, started 123439672811648)>, , , , , ] {{(pid=76496) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 21:48:56 devstack cinder-volume[76496]: DEBUG oslo_service.periodic_task [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76496) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:48:56 devstack cinder-volume[76496]: DEBUG cinder.volume.drivers.lvm [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Updating volume stats {{(pid=76496) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 21:48:56 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:48:56 devstack sudo[83695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 21:48:56 devstack sudo[83695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:48:57 devstack sudo[83695]: pam_unix(sudo:session): session closed for user root Jul 07 21:48:57 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:48:57 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:48:57 devstack sudo[83731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 21:48:57 devstack sudo[83731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:48:57 devstack sudo[83731]: pam_unix(sudo:session): session closed for user root Jul 07 21:48:57 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:48:57 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:48:57 devstack sudo[83796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 21:48:57 devstack sudo[83796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:48:58 devstack sudo[83796]: pam_unix(sudo:session): session closed for user root Jul 07 21:48:58 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.662s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:48:58 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:48:58 devstack sudo[83811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 21:48:58 devstack sudo[83811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:48:59 devstack sudo[83811]: pam_unix(sudo:session): session closed for user root Jul 07 21:48:59 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:48:59 devstack cinder-volume[76496]: DEBUG cinder.manager [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Notifying Schedulers of capabilities ... {{(pid=76496) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:48:59 devstack cinder-volume[76496]: DEBUG oslo_service.periodic_task [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running periodic task VolumeManager._thread_info {{(pid=76496) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:48:59 devstack cinder-volume[76496]: DEBUG cinder.volume.manager [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] thread count: 6 {{(pid=76496) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 21:48:59 devstack cinder-volume[76496]: DEBUG cinder.volume.manager [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] thread info: [<_MainThread(MainThread, started 123439672811648)>, , , , , ] {{(pid=76496) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 21:49:50 devstack cinder-volume[76496]: DEBUG dbcounter [-] [76496] Writing DB stats cinder:SELECT=1 {{(pid=76496) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:49:50 devstack cinder-volume[76496]: DEBUG dbcounter [-] [76496] Writing DB stats cinder:UPDATE=1 {{(pid=76496) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:49:56 devstack cinder-volume[76496]: DEBUG oslo_service.periodic_task [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76496) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:49:56 devstack cinder-volume[76496]: DEBUG cinder.volume.drivers.lvm [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Updating volume stats {{(pid=76496) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 21:49:56 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:49:56 devstack sudo[85237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 21:49:56 devstack sudo[85237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:49:57 devstack sudo[85237]: pam_unix(sudo:session): session closed for user root Jul 07 21:49:57 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.671s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:49:57 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:49:57 devstack sudo[85246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 21:49:57 devstack sudo[85246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:49:57 devstack sudo[85246]: pam_unix(sudo:session): session closed for user root Jul 07 21:49:57 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:49:57 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:49:57 devstack sudo[85271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 21:49:57 devstack sudo[85271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:49:58 devstack sudo[85271]: pam_unix(sudo:session): session closed for user root Jul 07 21:49:58 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.648s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:49:58 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:49:58 devstack sudo[85281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 21:49:58 devstack sudo[85281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:49:59 devstack sudo[85281]: pam_unix(sudo:session): session closed for user root Jul 07 21:49:59 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:49:59 devstack cinder-volume[76496]: DEBUG cinder.manager [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Notifying Schedulers of capabilities ... {{(pid=76496) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:49:59 devstack cinder-volume[76496]: DEBUG oslo_service.periodic_task [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running periodic task VolumeManager._thread_info {{(pid=76496) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:49:59 devstack cinder-volume[76496]: DEBUG cinder.volume.manager [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] thread count: 6 {{(pid=76496) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 21:49:59 devstack cinder-volume[76496]: DEBUG cinder.volume.manager [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] thread info: [<_MainThread(MainThread, started 123439672811648)>, , , , , ] {{(pid=76496) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 21:50:56 devstack cinder-volume[76278]: INFO oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Caught SIGTERM, stopping children Jul 07 21:50:56 devstack cinder-volume[76278]: DEBUG oslo_concurrency.lockutils [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Acquiring lock "singleton_lock" {{(pid=76278) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 21:50:56 devstack cinder-volume[76278]: DEBUG oslo_concurrency.lockutils [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Acquired lock "singleton_lock" {{(pid=76278) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 21:50:56 devstack cinder-volume[76278]: DEBUG oslo_concurrency.lockutils [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Releasing lock "singleton_lock" {{(pid=76278) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 21:50:56 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Stop services. {{(pid=76278) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 21:50:56 devstack cinder-volume[76278]: DEBUG oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Killing children. {{(pid=76278) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 21:50:56 devstack cinder-volume[76278]: INFO oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Waiting on 1 children to exit Jul 07 21:50:56 devstack cinder-volume[76496]: DEBUG oslo_service.periodic_task [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76496) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:50:56 devstack cinder-volume[76496]: DEBUG cinder.volume.drivers.lvm [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Updating volume stats {{(pid=76496) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 21:50:56 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:50:56 devstack sudo[86656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 21:50:56 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:50:57 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root Jul 07 21:50:57 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:50:57 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:50:57 devstack sudo[86659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 21:50:57 devstack sudo[86659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:50:57 devstack sudo[86659]: pam_unix(sudo:session): session closed for user root Jul 07 21:50:57 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:50:57 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:50:57 devstack sudo[86662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 21:50:57 devstack sudo[86662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:50:58 devstack sudo[86662]: pam_unix(sudo:session): session closed for user root Jul 07 21:50:58 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.633s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:50:58 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:50:58 devstack sudo[86665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 21:50:58 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:50:59 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root Jul 07 21:50:59 devstack cinder-volume[76496]: DEBUG oslo_concurrency.processutils [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=76496) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:50:59 devstack cinder-volume[76496]: DEBUG cinder.manager [None req-3f22417c-28b7-43a7-bb47-d64afe5435c1 None None] Notifying Schedulers of capabilities ... {{(pid=76496) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:50:59 devstack cinder-volume[76496]: DEBUG oslo_concurrency.lockutils [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Acquiring lock "singleton_lock" {{(pid=76496) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 21:50:59 devstack cinder-volume[76496]: DEBUG oslo_concurrency.lockutils [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Acquired lock "singleton_lock" {{(pid=76496) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 21:50:59 devstack cinder-volume[76496]: DEBUG oslo_concurrency.lockutils [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Releasing lock "singleton_lock" {{(pid=76496) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 21:50:59 devstack cinder-volume[76496]: WARNING amqp [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 21:50:59 devstack cinder-volume[76496]: WARNING amqp [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 21:50:59 devstack cinder-volume[76278]: INFO oslo_service.backend._eventlet.service [None req-6818a1de-5603-48ad-8b17-a3f2a591c81c None None] Child 76496 exited with status 0 Jul 07 21:50:59 devstack cinder-volume[86669]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 21:50:59 devstack cinder-volume[86669]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 21:50:59 devstack cinder-volume[86669]: we strongly recommend against using it for new projects. Jul 07 21:50:59 devstack cinder-volume[86669]: If you are already using Eventlet, we recommend migrating to a different Jul 07 21:50:59 devstack cinder-volume[86669]: framework. For more detail see Jul 07 21:50:59 devstack cinder-volume[86669]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 21:50:59 devstack cinder-volume[86669]: import eventlet # noqa Jul 07 21:51:01 devstack cinder-volume[86669]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86669) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 21:51:01 devstack cinder-volume[86669]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86669) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 21:51:01 devstack cinder-volume[86669]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86669) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 21:51:02 devstack cinder-volume[86669]: INFO dbcounter [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Registered counter for database cinder Jul 07 21:51:02 devstack cinder-volume[86669]: DEBUG oslo_db.sqlalchemy.engines [None req-247012ad-2d72-442b-808e-958c9d06987f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86669) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 21:51:02 devstack cinder-volume[86669]: DEBUG dbcounter [-] [86669] Writer thread running {{(pid=86669) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 21:51:02 devstack cinder-volume[86669]: INFO cinder.rpc [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 21:51:02 devstack cinder-volume[86669]: INFO cinder.rpc [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 21:51:02 devstack cinder-volume[86669]: DEBUG oslo_db.sqlalchemy.engines [None req-247012ad-2d72-442b-808e-958c9d06987f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86669) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 21:51:02 devstack cinder-volume[86669]: INFO cinder.volume.manager [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Determined volume DB was empty at startup. Jul 07 21:51:02 devstack cinder-volume[86669]: DEBUG cinder.volume.manager [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86669) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 21:51:02 devstack cinder-volume[86669]: INFO cinder.volume.manager [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 21:51:02 devstack cinder-volume[86669]: WARNING stevedore.named [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 21:51:02 devstack cinder-volume[86669]: WARNING castellan.key_manager [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 21:51:02 devstack cinder-volume[86669]: WARNING cinder.keymgr.conf_key_mgr [None req-247012ad-2d72-442b-808e-958c9d06987f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 21:51:02 devstack cinder-volume[86669]: INFO cinder.volume.manager [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_db.sqlalchemy.engines [None req-247012ad-2d72-442b-808e-958c9d06987f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86669) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 21:51:03 devstack cinder-volume[86669]: INFO oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Starting 1 workers Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Started child 86883 {{(pid=86669) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Full set of CONF: {{(pid=86669) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] ******************************************************************************** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Configuration options gathered from: {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] ================================================================================ {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] allow_availability_zone_fallback = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] allow_compression_on_image_upload = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] allowed_direct_url_schemes = [] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] api_rate_limit = True {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86883]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] auth_strategy = keystone {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_availability_zone = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_host = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_name = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_stats_polling_interval = 60 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backup_api_class = cinder.backup.api.API {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backup_name_template = backup-%s {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backup_use_same_host = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backup_use_temp_snapshot = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] chap_password = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] chap_username = {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cinder_internal_tenant_project_id = 7f5c4dcdd0564605927fbcd21569966e {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cinder_internal_tenant_user_id = 178000ca047b4ff1be6359d2f32d6a4c {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cluster = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] compression_format = gzip {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] compute_api_class = cinder.compute.nova.API {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] config_dir = [] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] config_source = [] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] control_exchange = openstack {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] debug = True {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] default_availability_zone = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] default_group_type = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] default_volume_type = QuobyteHD {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] disk_geometry = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] driver_client_cert = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] driver_client_cert_key = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] driver_data_namespace = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] driver_ssl_cert_path = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] driver_ssl_cert_verify = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] driver_use_ssl = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] enable_new_services = True {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] enable_unsupported_driver = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] enabled_backends = ['QuobyteHD'] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] enforce_multipath_for_image_xfer = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] filter_function = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] glance_api_insecure = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] glance_api_servers = ['http://192.168.122.248/image'] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] glance_api_ssl_compression = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] glance_ca_certificates_file = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] glance_catalog_info = image:glance:publicURL {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] glance_certfile = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] glance_keyfile = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] glance_num_retries = 3 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] glance_request_timeout = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] goodness_function = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] graceful_shutdown_timeout = 5 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] group_api_class = cinder.group.api.API {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] host = devstack {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] image_compress_on_upload = True {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] image_conversion_address_space_limit = 1 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] image_conversion_cpu_limit = 60 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] image_conversion_disable = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] image_upload_use_cinder_backend = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] image_upload_use_internal_tenant = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] image_volume_cache_enabled = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] image_volume_cache_max_count = 0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] image_volume_cache_max_size_gb = 0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] init_host_max_objects_retrieval = 0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] instance_format = [instance: %(uuid)s] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] iscsi_target_flags = {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] iscsi_write_cache = on {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] iser_helper = tgtadm {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] iser_ip_address = 192.168.122.248 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] iser_port = 3260 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] log_color = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] log_config_append = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] log_dir = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] log_file = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] log_options = True {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] log_rotate_interval = 1 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] log_rotate_interval_type = days {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] log_rotation_type = none {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] max_age = 0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] max_logfile_count = 30 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] max_logfile_size_mb = 200 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] max_over_subscription_ratio = 20.0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86883]: INFO cinder.volume.manager [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 21:51:03 devstack cinder-volume[86883]: DEBUG cinder.volume.drivers.remotefs [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86883) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] message_reap_interval = 86400 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] message_ttl = 2592000 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] migration_create_volume_timeout_secs = 300 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] monkey_patch = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] monkey_patch_modules = [] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] my_ip = 192.168.122.248 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] no_snapshot_gb_quota = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] num_iser_scan_tries = 3 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] num_shell_tries = 3 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] num_volume_device_scan_tries = 3 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] nvmeof_conn_info_version = 1 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] nvmet_ns_id = 10 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] nvmet_port_id = 1 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] osapi_max_limit = 1000 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] osapi_volume_ext_list = [] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] osapi_volume_listen = 0.0.0.0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] osapi_volume_listen_port = 8776 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] osapi_volume_use_ssl = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] osapi_volume_workers = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] per_volume_size_limit = -1 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] periodic_fuzzy_delay = 60 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] periodic_interval = 60 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] project_id_regex = [0-9a-f\-]+ {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] public_endpoint = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] publish_errors = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] quota_backup_gigabytes = 1000 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] quota_backups = 10 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] quota_gigabytes = 1000 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] quota_groups = 10 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] quota_snapshots = 10 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] quota_volumes = 10 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] rate_limit_burst = 0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] rate_limit_except_level = CRITICAL {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] rate_limit_interval = 0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] reinit_driver_count = 3 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] replication_device = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] report_discard_supported = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] report_interval = 120 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] reservation_clean_interval = 86400 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] reservation_expire = 86400 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] reserved_image_namespaces = [] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] reserved_percentage = 0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] rpc_response_timeout = 120 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] run_external_periodic_tasks = True {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] scst_target_driver = iscsi {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] scst_target_iqn_name = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] service_down_time = 720 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] shell_completion = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] snapshot_name_template = snapshot-%s {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] split_loggers = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] state_path = /opt/stack/data/cinder {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] storage_availability_zone = nova {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] storage_protocol = iSCSI {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] syslog_log_facility = LOG_USER {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] target_helper = lioadm {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] target_ip_address = 192.168.122.248 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] target_port = 3260 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] target_protocol = iscsi {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] target_secondary_ip_addresses = [] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] trace_flags = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] transfer_api_class = cinder.transfer.api.API {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] transport_url = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] until_refresh = 0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] use_chap_auth = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] use_default_quota_class = True {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] use_journal = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] use_json = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] use_multipath_for_image_xfer = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] use_stderr = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] use_syslog = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] verify_glance_signatures = enabled {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] volume_api_class = cinder.volume.api.API {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] volume_backend_name = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] volume_clear = zero {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] volume_clear_ionice = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] volume_clear_size = 0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] volume_copy_bps_limit = 0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] volume_dd_blocksize = 1M {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] volume_name_template = volume-%s {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] volume_service_inithost_offload = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] volume_usage_audit_period = month {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] zoning_mode = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_concurrency.disable_process_locking = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.auth_section = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.auth_type = password {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.auth_version = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.cache = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.certfile = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.delay_auth_decision = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.http_connect_timeout = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.include_service_catalog = True {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.insecure = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.interface = public {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.keyfile = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.memcache_password = {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.memcache_username = {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.region_name = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.service_token_roles_required = True {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.service_type = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.token_cache_time = 300 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.248/identity {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.backend = dogpile.cache.null {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.backend_argument = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.backend_expiration_time = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.config_prefix = cache.oslo {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.debug_cache_backend = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.enable_retry_client = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.enable_socket_keepalive = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.enabled = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.expiration_time = 600 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.hashclient_retry_attempts = 2 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.memcache_dead_retry = 300 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.memcache_pool_maxsize = 10 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.memcache_sasl_enabled = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.password = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.proxies = [] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.redis_db = 0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.redis_sentinel_service_name = mymaster {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.redis_server = localhost:6379 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.retry_attempts = 2 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.retry_delay = 0.0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.socket_keepalive_count = 1 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.socket_keepalive_idle = 1 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.socket_keepalive_interval = 1 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.socket_timeout = 1.0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.tls_allowed_ciphers = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.tls_cafile = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.tls_certfile = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.tls_enabled = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86883]: DEBUG cinder.volume.drivers.quobyte [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86883) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.tls_keyfile = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86883]: WARNING cinder.volume.drivers.quobyte [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cache.username = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] coordination.backend_url = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86883]: WARNING cinder.volume.drivers.quobyte [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.asyncio_connection = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.asyncio_slave_connection = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.backend = sqlalchemy {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86883]: DEBUG oslo_concurrency.processutils [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Running cmd (subprocess): mount.quobyte {{(pid=86883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.connection = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.connection_debug = 0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.connection_parameters = {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.connection_recycle_time = 3600 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.connection_trace = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.db_inc_retry_interval = True {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.db_max_retries = 20 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.db_max_retry_interval = 10 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.db_retry_interval = 1 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.max_overflow = 50 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.max_pool_size = 5 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.max_retries = 10 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.mysql_wsrep_sync_wait = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.pool_timeout = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.retry_interval = 10 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.slave_connection = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.sqlite_synchronous = True {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.synchronous_reader = True {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] database.use_db_reconnect = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] profiler.connection_string = messaging:// {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] profiler.enabled = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] profiler.es_doc_type = notification {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] profiler.es_scroll_size = 10000 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] profiler.es_scroll_time = 2m {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] profiler.filter_error_trace = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] profiler.hmac_keys = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] profiler.sentinel_service_name = mymaster {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] profiler.socket_timeout = 0.1 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] profiler.trace_requests = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] profiler.trace_sqlalchemy = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] profiler_jaeger.process_tags = {} {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] profiler_jaeger.service_name_prefix = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] profiler_otlp.service_name_prefix = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_policy.enforce_new_defaults = True {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_policy.enforce_scope = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_policy.policy_default_rule = default {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_policy.policy_file = policy.yaml {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_policy.remote_timeout = 60.0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] privsep_osbrick.group = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] privsep_osbrick.helper_command = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] privsep_osbrick.user = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cinder_sys_admin.group = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cinder_sys_admin.helper_command = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] cinder_sys_admin.user = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] service_user.auth_section = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] service_user.auth_type = password {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] service_user.cafile = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] service_user.certfile = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] service_user.collect_timing = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] service_user.insecure = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] service_user.keyfile = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] service_user.send_service_user_token = True {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] service_user.split_loggers = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] service_user.timeout = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] glance.auth_section = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] glance.auth_type = password {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] glance.certfile = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] glance.collect_timing = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] glance.insecure = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] glance.keyfile = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] glance.region_name = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] glance.split_loggers = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] glance.timeout = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.backend_availability_zone = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.chap_password = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.chap_username = {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack quobyte-client[86888]: Reading configuration file: /etc/quobyte/client.cfg Jul 07 21:51:03 devstack quobyte-client[86888]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.disk_geometry = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.driver_client_cert = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.driver_client_cert_key = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.driver_data_namespace = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86883]: DEBUG oslo_concurrency.processutils [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] CMD "mount.quobyte" returned: 1 in 0.074s {{(pid=86883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:51:03 devstack cinder-volume[86883]: DEBUG oslo_concurrency.lockutils [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86883) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:51:03 devstack cinder-volume[86883]: DEBUG oslo_concurrency.lockutils [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86883) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:51:03 devstack cinder-volume[86883]: DEBUG cinder.volume.drivers.quobyte [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=86883) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86883]: INFO cinder.volume.drivers.quobyte [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 ... Jul 07 21:51:03 devstack cinder-volume[86883]: DEBUG oslo_concurrency.processutils [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f -c /etc/quobyte/client-cinder.cfg {{(pid=86883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.driver_use_ssl = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.enable_unsupported_driver = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.extra_capabilities = {} {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.filter_function = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.goodness_function = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.iscsi_target_flags = {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.iscsi_write_cache = on {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.iser_helper = tgtadm {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.iser_ip_address = 192.168.122.248 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.iser_port = 3260 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.nas_host = {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.nas_login = admin {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.nas_mount_options = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.nas_password = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.nas_private_key = {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.nas_share_path = {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.nas_ssh_port = 22 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.num_shell_tries = 3 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.nvmet_port_id = 1 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.quobyte_client_cfg = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack sudo[86889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f -c /etc/quobyte/client-cinder.cfg Jul 07 21:51:03 devstack sudo[86889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.quobyte_volume_url = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.replication_device = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.report_discard_supported = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.reserved_percentage = 0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.scst_target_driver = iscsi {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.scst_target_iqn_name = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.storage_protocol = iSCSI {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.target_helper = tgtadm {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.target_ip_address = 192.168.122.248 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.target_port = 3260 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.target_protocol = iscsi {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.trace_flags = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.unique_fqdn_network = True {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.use_chap_auth = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.volume_backend_name = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.volume_clear = zero {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.volume_clear_ionice = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.volume_clear_size = 0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_reports.file_event_handler = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_reports.log_dir = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.backend_availability_zone = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.backend_host = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.chap_password = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.chap_username = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.chiscsi_conf = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.disk_geometry = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.driver_client_cert = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.driver_client_cert_key = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.driver_data_namespace = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.driver_use_ssl = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.extra_capabilities = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.filter_function = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.goodness_function = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.iscsi_target_flags = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.iscsi_write_cache = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.iser_helper = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.iser_ip_address = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.iser_port = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.iser_target_prefix = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.nas_host = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.nas_login = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.nas_mount_options = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.nas_password = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.nas_private_key = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.nas_share_path = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.nas_ssh_port = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.num_shell_tries = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.nvmet_ns_id = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.nvmet_port_id = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.replication_device = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.report_discard_supported = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.reserved_percentage = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.scst_target_driver = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.storage_protocol = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.target_helper = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.target_ip_address = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.target_port = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.target_prefix = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.target_protocol = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.trace_flags = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.unique_fqdn_network = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.use_chap_auth = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.volume_clear = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.volume_clear_ionice = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.volume_clear_size = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] QuobyteHD.volumes_dir = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.ssl = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.ssl_version = {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_notifications.driver = [] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_notifications.retry = -1 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] oslo_messaging_notifications.transport_url = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] key_manager.fixed_key = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican.barbican_api_version = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican.barbican_endpoint = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican.barbican_endpoint_type = public {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican.barbican_region_name = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican.cafile = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican.certfile = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican.collect_timing = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican.insecure = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican.keyfile = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican.number_of_retries = 60 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican.retry_delay = 1 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican.send_service_user_token = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican.split_loggers = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican.timeout = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican.verify_ssl = True {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican.verify_ssl_path = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican_service_user.auth_section = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican_service_user.auth_type = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican_service_user.cafile = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican_service_user.certfile = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican_service_user.collect_timing = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican_service_user.insecure = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican_service_user.keyfile = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican_service_user.split_loggers = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] barbican_service_user.timeout = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] vault.approle_role_id = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] vault.approle_secret_id = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] vault.kv_mountpoint = secret {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] vault.kv_path = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] vault.kv_version = 2 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] vault.namespace = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] vault.root_token_id = **** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] vault.ssl_ca_crt_file = None {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] vault.timeout = 60.0 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] vault.use_ssl = False {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:03 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] ******************************************************************************** {{(pid=86669) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 21:51:04 devstack sudo[86889]: pam_unix(sudo:session): session closed for user root Jul 07 21:51:04 devstack cinder-volume[86883]: DEBUG oslo_concurrency.processutils [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.933s {{(pid=86883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:51:04 devstack cinder-volume[86883]: INFO cinder.volume.drivers.quobyte [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 succeeded Jul 07 21:51:04 devstack cinder-volume[86883]: DEBUG cinder.volume.drivers.quobyte [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=86883) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:51:04 devstack cinder-volume[86883]: DEBUG oslo_concurrency.lockutils [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.944s {{(pid=86883) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:51:04 devstack cinder-volume[86883]: DEBUG oslo_concurrency.processutils [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=86883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:51:04 devstack sudo[86958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:51:04 devstack sudo[86958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:51:04 devstack sudo[86958]: pam_unix(sudo:session): session closed for user root Jul 07 21:51:04 devstack cinder-volume[86883]: DEBUG oslo_concurrency.processutils [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.657s {{(pid=86883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:51:04 devstack cinder-volume[86883]: INFO cinder.volume.driver [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Driver hasn't implemented _init_vendor_properties() Jul 07 21:51:05 devstack cinder-volume[86883]: DEBUG cinder.volume.driver [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.713264465332, 'free_capacity_gb': 1775.713264465332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86883) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 21:51:05 devstack cinder-volume[86883]: DEBUG oslo_db.sqlalchemy.engines [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86883) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 21:51:05 devstack cinder-volume[86883]: DEBUG dbcounter [-] [86883] Writer thread running {{(pid=86883) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 21:51:05 devstack cinder-volume[86883]: DEBUG cinder.db.api [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Building query based on filter {{(pid=86883) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 21:51:05 devstack cinder-volume[86883]: DEBUG cinder.image.image_utils [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86883) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 21:51:05 devstack cinder-volume[86883]: INFO cinder.keymgr.migration [None req-a0a42992-b4d8-46eb-b9c0-a156ec06ebb8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 21:51:05 devstack cinder-volume[86883]: DEBUG oslo_concurrency.lockutils [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86883) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:51:05 devstack cinder-volume[86883]: DEBUG oslo_concurrency.lockutils [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86883) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:51:05 devstack cinder-volume[86883]: DEBUG cinder.volume.drivers.quobyte [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=86883) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:51:05 devstack cinder-volume[86883]: DEBUG cinder.volume.drivers.quobyte [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=86883) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:51:05 devstack cinder-volume[86883]: DEBUG oslo_concurrency.lockutils [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86883) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:51:05 devstack cinder-volume[86883]: DEBUG oslo_concurrency.processutils [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=86883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:51:05 devstack sudo[86961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:51:05 devstack sudo[86961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:51:05 devstack sudo[86961]: pam_unix(sudo:session): session closed for user root Jul 07 21:51:05 devstack cinder-volume[86883]: DEBUG oslo_concurrency.processutils [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.740s {{(pid=86883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:51:05 devstack cinder-volume[86883]: DEBUG cinder.manager [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Notifying Schedulers of capabilities ... {{(pid=86883) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:51:05 devstack cinder-volume[86883]: INFO cinder.volume.manager [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Driver initialization completed successfully. Jul 07 21:51:05 devstack cinder-volume[86883]: INFO cinder.manager [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Initiating service 3 cleanup Jul 07 21:51:05 devstack cinder-volume[86883]: INFO cinder.manager [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Service 3 cleanup completed. Jul 07 21:51:05 devstack cinder-volume[86883]: DEBUG cinder.service [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Creating RPC server for service cinder-volume {{(pid=86883) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 21:51:05 devstack cinder-volume[86883]: DEBUG cinder.service [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86883) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 21:51:06 devstack cinder-volume[86883]: INFO cinder.volume.manager [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 21:51:06 devstack cinder-volume[86883]: DEBUG oslo_concurrency.lockutils [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86883) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:51:06 devstack cinder-volume[86883]: DEBUG oslo_concurrency.lockutils [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86883) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:51:06 devstack cinder-volume[86883]: DEBUG cinder.volume.drivers.quobyte [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=86883) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:51:06 devstack cinder-volume[86883]: DEBUG cinder.volume.drivers.quobyte [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=86883) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:51:06 devstack cinder-volume[86883]: DEBUG oslo_concurrency.lockutils [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86883) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:51:06 devstack cinder-volume[86883]: DEBUG oslo_concurrency.processutils [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=86883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:51:06 devstack sudo[86969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:51:06 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:51:06 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root Jul 07 21:51:06 devstack cinder-volume[86883]: DEBUG oslo_concurrency.processutils [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.793s {{(pid=86883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:51:06 devstack cinder-volume[86883]: INFO cinder.volume.manager [None req-07dffb6b-f265-4178-9b29-90b4d6a78156 None None] Driver post RPC initialization completed successfully. Jul 07 21:51:11 devstack cinder-volume[86883]: DEBUG oslo_concurrency.lockutils [None req-1d7b1d77-ac9e-4c1f-8fd3-160f99d70c0d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86883) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:51:11 devstack cinder-volume[86883]: DEBUG oslo_concurrency.lockutils [None req-1d7b1d77-ac9e-4c1f-8fd3-160f99d70c0d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86883) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:51:11 devstack cinder-volume[86883]: DEBUG cinder.volume.drivers.quobyte [None req-1d7b1d77-ac9e-4c1f-8fd3-160f99d70c0d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=86883) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:51:11 devstack cinder-volume[86883]: DEBUG cinder.volume.drivers.quobyte [None req-1d7b1d77-ac9e-4c1f-8fd3-160f99d70c0d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=86883) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:51:11 devstack cinder-volume[86883]: DEBUG oslo_concurrency.lockutils [None req-1d7b1d77-ac9e-4c1f-8fd3-160f99d70c0d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86883) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:51:11 devstack cinder-volume[86883]: DEBUG oslo_concurrency.processutils [None req-1d7b1d77-ac9e-4c1f-8fd3-160f99d70c0d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=86883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:51:11 devstack sudo[87156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:51:11 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:51:11 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root Jul 07 21:51:11 devstack cinder-volume[86883]: DEBUG oslo_concurrency.processutils [None req-1d7b1d77-ac9e-4c1f-8fd3-160f99d70c0d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.684s {{(pid=86883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:51:11 devstack cinder-volume[86883]: DEBUG cinder.manager [None req-1d7b1d77-ac9e-4c1f-8fd3-160f99d70c0d None None] Notifying Schedulers of capabilities ... {{(pid=86883) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:51:11 devstack cinder-volume[86669]: INFO oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Caught SIGTERM, stopping children Jul 07 21:51:11 devstack cinder-volume[86669]: DEBUG oslo_concurrency.lockutils [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Acquiring lock "singleton_lock" {{(pid=86669) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 21:51:11 devstack cinder-volume[86669]: DEBUG oslo_concurrency.lockutils [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Acquired lock "singleton_lock" {{(pid=86669) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 21:51:11 devstack cinder-volume[86669]: DEBUG oslo_concurrency.lockutils [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Releasing lock "singleton_lock" {{(pid=86669) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 21:51:11 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Stop services. {{(pid=86669) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 21:51:11 devstack cinder-volume[86669]: DEBUG oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Killing children. {{(pid=86669) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 21:51:11 devstack cinder-volume[86669]: INFO oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Waiting on 1 children to exit Jul 07 21:51:14 devstack cinder-volume[86883]: DEBUG oslo_concurrency.lockutils [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Acquiring lock "singleton_lock" {{(pid=86883) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 21:51:14 devstack cinder-volume[86883]: DEBUG oslo_concurrency.lockutils [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Acquired lock "singleton_lock" {{(pid=86883) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 21:51:14 devstack cinder-volume[86883]: DEBUG oslo_concurrency.lockutils [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Releasing lock "singleton_lock" {{(pid=86883) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 21:51:14 devstack cinder-volume[86883]: WARNING amqp [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 21:51:14 devstack cinder-volume[86883]: WARNING amqp [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 21:51:14 devstack cinder-volume[86669]: INFO oslo_service.backend._eventlet.service [None req-247012ad-2d72-442b-808e-958c9d06987f None None] Child 86883 exited with status 0 Jul 07 21:51:15 devstack cinder-volume[87262]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 21:51:15 devstack cinder-volume[87262]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 21:51:15 devstack cinder-volume[87262]: we strongly recommend against using it for new projects. Jul 07 21:51:15 devstack cinder-volume[87262]: If you are already using Eventlet, we recommend migrating to a different Jul 07 21:51:15 devstack cinder-volume[87262]: framework. For more detail see Jul 07 21:51:15 devstack cinder-volume[87262]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 21:51:15 devstack cinder-volume[87262]: import eventlet # noqa Jul 07 21:51:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87262) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 21:51:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87262) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 21:51:17 devstack cinder-volume[87262]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87262) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 21:51:18 devstack cinder-volume[87262]: INFO dbcounter [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] Registered counter for database cinder Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_db.sqlalchemy.engines [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87262) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writer thread running {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 21:51:19 devstack cinder-volume[87262]: INFO cinder.rpc [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 21:51:19 devstack cinder-volume[87262]: INFO cinder.rpc [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_db.sqlalchemy.engines [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87262) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 21:51:19 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] Determined volume DB was empty at startup. Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG cinder.volume.manager [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87262) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 21:51:19 devstack cinder-volume[87262]: WARNING stevedore.named [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 21:51:19 devstack cinder-volume[87262]: WARNING castellan.key_manager [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 21:51:19 devstack cinder-volume[87262]: WARNING cinder.keymgr.conf_key_mgr [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 21:51:19 devstack cinder-volume[87262]: INFO cinder.volume.manager [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_db.sqlalchemy.engines [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87262) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 21:51:19 devstack cinder-volume[87262]: INFO oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] Starting 1 workers Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] Started child 87586 {{(pid=87262) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] Full set of CONF: {{(pid=87262) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 21:51:19 devstack cinder-volume[87586]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] ******************************************************************************** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] Configuration options gathered from: {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] ================================================================================ {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] allow_availability_zone_fallback = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] allow_compression_on_image_upload = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] allowed_direct_url_schemes = [] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] api_rate_limit = True {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] auth_strategy = keystone {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_availability_zone = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_host = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_name = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_stats_polling_interval = 60 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backup_api_class = cinder.backup.api.API {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backup_name_template = backup-%s {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backup_use_same_host = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backup_use_temp_snapshot = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] chap_password = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] chap_username = {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cinder_internal_tenant_project_id = 7f5c4dcdd0564605927fbcd21569966e {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cinder_internal_tenant_user_id = 178000ca047b4ff1be6359d2f32d6a4c {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cluster = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] compression_format = gzip {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] compute_api_class = cinder.compute.nova.API {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] config_dir = [] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] config_source = [] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] control_exchange = openstack {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] debug = True {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] default_availability_zone = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] default_group_type = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] default_volume_type = QuobyteHD {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] disk_geometry = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] driver_client_cert = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] driver_client_cert_key = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] driver_data_namespace = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] driver_ssl_cert_path = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] driver_ssl_cert_verify = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] driver_use_ssl = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] enable_new_services = True {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] enable_unsupported_driver = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] enabled_backends = ['QuobyteHD'] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] enforce_multipath_for_image_xfer = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] filter_function = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] glance_api_insecure = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] glance_api_servers = ['http://192.168.122.248/image'] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] glance_api_ssl_compression = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] glance_ca_certificates_file = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] glance_catalog_info = image:glance:publicURL {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] glance_certfile = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] glance_keyfile = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] glance_num_retries = 3 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] glance_request_timeout = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] goodness_function = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] graceful_shutdown_timeout = 5 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] group_api_class = cinder.group.api.API {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] host = devstack {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] image_compress_on_upload = True {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] image_conversion_address_space_limit = 1 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] image_conversion_cpu_limit = 60 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] image_conversion_disable = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 21:51:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87586) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] image_upload_use_cinder_backend = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] image_upload_use_internal_tenant = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] image_volume_cache_enabled = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] image_volume_cache_max_count = 0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] image_volume_cache_max_size_gb = 0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] init_host_max_objects_retrieval = 0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] instance_format = [instance: %(uuid)s] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] iscsi_target_flags = {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] iscsi_write_cache = on {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] iser_helper = tgtadm {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] iser_ip_address = 192.168.122.248 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] iser_port = 3260 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] log_color = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] log_config_append = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] log_dir = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] log_file = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] log_options = True {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] log_rotate_interval = 1 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] log_rotate_interval_type = days {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] log_rotation_type = none {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] max_age = 0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] max_logfile_count = 30 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] max_logfile_size_mb = 200 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] max_over_subscription_ratio = 20.0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] message_reap_interval = 86400 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] message_ttl = 2592000 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] migration_create_volume_timeout_secs = 300 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] monkey_patch = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] monkey_patch_modules = [] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] my_ip = 192.168.122.248 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] no_snapshot_gb_quota = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] num_iser_scan_tries = 3 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] num_shell_tries = 3 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] num_volume_device_scan_tries = 3 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] nvmeof_conn_info_version = 1 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] nvmet_ns_id = 10 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] nvmet_port_id = 1 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] osapi_max_limit = 1000 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] osapi_volume_ext_list = [] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] osapi_volume_listen = 0.0.0.0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] osapi_volume_listen_port = 8776 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] osapi_volume_use_ssl = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] osapi_volume_workers = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] per_volume_size_limit = -1 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] periodic_fuzzy_delay = 60 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] periodic_interval = 60 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] project_id_regex = [0-9a-f\-]+ {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] public_endpoint = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] publish_errors = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] quota_backup_gigabytes = 1000 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] quota_backups = 10 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] quota_gigabytes = 1000 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] quota_groups = 10 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] quota_snapshots = 10 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] quota_volumes = 10 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] rate_limit_burst = 0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:19 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] rate_limit_except_level = CRITICAL {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] rate_limit_interval = 0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] reinit_driver_count = 3 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] replication_device = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] report_discard_supported = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] report_interval = 120 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] reservation_clean_interval = 86400 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] reservation_expire = 86400 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] reserved_image_namespaces = [] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] reserved_percentage = 0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] rpc_response_timeout = 120 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] run_external_periodic_tasks = True {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] scst_target_driver = iscsi {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] scst_target_iqn_name = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] service_down_time = 720 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] shell_completion = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] snapshot_name_template = snapshot-%s {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] split_loggers = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] state_path = /opt/stack/data/cinder {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] storage_availability_zone = nova {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] storage_protocol = iSCSI {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] syslog_log_facility = LOG_USER {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] target_helper = lioadm {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] target_ip_address = 192.168.122.248 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] target_port = 3260 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] target_protocol = iscsi {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] target_secondary_ip_addresses = [] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] trace_flags = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] transfer_api_class = cinder.transfer.api.API {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] transport_url = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] until_refresh = 0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] use_chap_auth = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] use_default_quota_class = True {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] use_journal = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] use_json = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] use_multipath_for_image_xfer = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] use_stderr = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] use_syslog = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] verify_glance_signatures = enabled {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] volume_api_class = cinder.volume.api.API {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] volume_backend_name = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] volume_clear = zero {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] volume_clear_ionice = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] volume_clear_size = 0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] volume_copy_bps_limit = 0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] volume_dd_blocksize = 1M {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] volume_name_template = volume-%s {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] volume_service_inithost_offload = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] volume_usage_audit_period = month {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] zoning_mode = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_concurrency.disable_process_locking = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87586) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 21:51:20 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.quobyte [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 21:51:20 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.quobyte [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 21:51:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Running cmd (subprocess): mount.quobyte {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.auth_section = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.auth_type = password {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.auth_version = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.cache = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.certfile = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.delay_auth_decision = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.http_connect_timeout = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.include_service_catalog = True {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.insecure = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.interface = public {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.keyfile = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.memcache_password = {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.memcache_username = {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.region_name = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.service_token_roles_required = True {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.service_type = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.token_cache_time = 300 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.248/identity {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.backend = dogpile.cache.null {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.backend_argument = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.backend_expiration_time = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.config_prefix = cache.oslo {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.debug_cache_backend = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.enable_retry_client = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.enable_socket_keepalive = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.enabled = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.expiration_time = 600 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.hashclient_retry_attempts = 2 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.memcache_dead_retry = 300 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.memcache_pool_maxsize = 10 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.memcache_sasl_enabled = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.password = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.proxies = [] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.redis_db = 0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.redis_sentinel_service_name = mymaster {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack quobyte-client[87587]: Reading configuration file: /etc/quobyte/client.cfg Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack quobyte-client[87587]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.redis_server = localhost:6379 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] CMD "mount.quobyte" returned: 1 in 0.056s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:51:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:51:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:51:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.retry_attempts = 2 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.retry_delay = 0.0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.socket_keepalive_count = 1 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.socket_keepalive_idle = 1 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.socket_keepalive_interval = 1 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.socket_timeout = 1.0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.tls_allowed_ciphers = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.tls_cafile = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.tls_certfile = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.tls_enabled = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.tls_keyfile = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cache.username = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] coordination.backend_url = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.asyncio_connection = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.asyncio_slave_connection = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.backend = sqlalchemy {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.connection = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.connection_debug = 0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.connection_parameters = {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.connection_recycle_time = 3600 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.connection_trace = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.db_inc_retry_interval = True {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.db_max_retries = 20 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.db_max_retry_interval = 10 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.db_retry_interval = 1 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.max_overflow = 50 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.max_pool_size = 5 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.max_retries = 10 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.mysql_wsrep_sync_wait = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.pool_timeout = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.retry_interval = 10 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.slave_connection = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.sqlite_synchronous = True {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.synchronous_reader = True {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] database.use_db_reconnect = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] profiler.connection_string = messaging:// {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] profiler.enabled = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] profiler.es_doc_type = notification {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] profiler.es_scroll_size = 10000 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] profiler.es_scroll_time = 2m {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] profiler.filter_error_trace = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] profiler.hmac_keys = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] profiler.sentinel_service_name = mymaster {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] profiler.socket_timeout = 0.1 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] profiler.trace_requests = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] profiler.trace_sqlalchemy = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] profiler_jaeger.process_tags = {} {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] profiler_jaeger.service_name_prefix = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] profiler_otlp.service_name_prefix = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_policy.enforce_new_defaults = True {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_policy.enforce_scope = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_policy.policy_default_rule = default {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_policy.policy_file = policy.yaml {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_policy.remote_timeout = 60.0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] privsep_osbrick.group = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] privsep_osbrick.helper_command = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] privsep_osbrick.user = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cinder_sys_admin.group = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cinder_sys_admin.helper_command = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] cinder_sys_admin.user = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] service_user.auth_section = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] service_user.auth_type = password {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] service_user.cafile = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack sudo[87588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] service_user.certfile = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] service_user.collect_timing = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] service_user.insecure = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] service_user.keyfile = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] service_user.send_service_user_token = True {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] service_user.split_loggers = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack sudo[87588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] service_user.timeout = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] glance.auth_section = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] glance.auth_type = password {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] glance.certfile = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] glance.collect_timing = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] glance.insecure = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] glance.keyfile = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] glance.region_name = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] glance.split_loggers = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] glance.timeout = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.backend_availability_zone = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.chap_password = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.chap_username = {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.disk_geometry = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.driver_client_cert = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.driver_client_cert_key = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.driver_data_namespace = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.driver_use_ssl = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.enable_unsupported_driver = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.extra_capabilities = {} {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.filter_function = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.goodness_function = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.iscsi_target_flags = {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.iscsi_write_cache = on {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.iser_helper = tgtadm {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.iser_ip_address = 192.168.122.248 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.iser_port = 3260 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.nas_host = {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.nas_login = admin {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.nas_mount_options = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.nas_password = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.nas_private_key = {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.nas_share_path = {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.nas_ssh_port = 22 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.num_shell_tries = 3 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.nvmet_port_id = 1 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.quobyte_client_cfg = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.quobyte_volume_url = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.replication_device = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.report_discard_supported = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.reserved_percentage = 0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.scst_target_driver = iscsi {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.scst_target_iqn_name = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.storage_protocol = iSCSI {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.target_helper = tgtadm {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.target_ip_address = 192.168.122.248 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.target_port = 3260 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.target_protocol = iscsi {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.trace_flags = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.unique_fqdn_network = True {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.use_chap_auth = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.volume_backend_name = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.volume_clear = zero {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.volume_clear_ionice = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.volume_clear_size = 0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_reports.file_event_handler = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_reports.log_dir = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.backend_availability_zone = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.backend_host = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.chap_password = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.chap_username = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.chiscsi_conf = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.disk_geometry = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.driver_client_cert = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.driver_client_cert_key = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.driver_data_namespace = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.driver_use_ssl = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.extra_capabilities = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.filter_function = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.goodness_function = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.iscsi_target_flags = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.iscsi_write_cache = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.iser_helper = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.iser_ip_address = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.iser_port = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.iser_target_prefix = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.nas_host = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.nas_login = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.nas_mount_options = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.nas_password = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.nas_private_key = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.nas_share_path = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.nas_ssh_port = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.num_shell_tries = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.nvmet_ns_id = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.nvmet_port_id = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.replication_device = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.report_discard_supported = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.reserved_percentage = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.scst_target_driver = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.storage_protocol = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.target_helper = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.target_ip_address = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.target_port = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.target_prefix = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.target_protocol = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.trace_flags = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.unique_fqdn_network = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.use_chap_auth = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.volume_clear = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.volume_clear_ionice = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.volume_clear_size = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] QuobyteHD.volumes_dir = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.ssl = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.ssl_version = {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_notifications.driver = [] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_notifications.retry = -1 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] oslo_messaging_notifications.transport_url = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] key_manager.fixed_key = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican.barbican_api_version = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican.barbican_endpoint = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican.barbican_endpoint_type = public {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican.barbican_region_name = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican.cafile = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican.certfile = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican.collect_timing = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican.insecure = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican.keyfile = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican.number_of_retries = 60 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican.retry_delay = 1 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican.send_service_user_token = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican.split_loggers = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican.timeout = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican.verify_ssl = True {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican.verify_ssl_path = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican_service_user.auth_section = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican_service_user.auth_type = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican_service_user.cafile = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican_service_user.certfile = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican_service_user.collect_timing = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican_service_user.insecure = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican_service_user.keyfile = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican_service_user.split_loggers = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] barbican_service_user.timeout = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] vault.approle_role_id = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] vault.approle_secret_id = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] vault.kv_mountpoint = secret {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] vault.kv_path = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] vault.kv_version = 2 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] vault.namespace = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] vault.root_token_id = **** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] vault.ssl_ca_crt_file = None {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] vault.timeout = 60.0 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] vault.use_ssl = False {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 21:51:20 devstack cinder-volume[87262]: DEBUG oslo_service.backend._eventlet.service [None req-1955f96f-9eb2-409f-995d-49d03198243d None None] ******************************************************************************** {{(pid=87262) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 21:51:20 devstack sudo[87588]: pam_unix(sudo:session): session closed for user root Jul 07 21:51:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.849s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:51:20 devstack cinder-volume[87586]: INFO cinder.volume.driver [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Driver hasn't implemented _init_vendor_properties() Jul 07 21:51:20 devstack cinder-volume[87586]: DEBUG cinder.volume.driver [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.693115234375, 'free_capacity_gb': 1775.693115234375, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87586) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 21:51:21 devstack cinder-volume[87586]: DEBUG oslo_db.sqlalchemy.engines [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87586) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 21:51:21 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writer thread running {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 21:51:21 devstack cinder-volume[87586]: DEBUG cinder.db.api [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Building query based on filter {{(pid=87586) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 21:51:21 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87586) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 21:51:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:51:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:51:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:51:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:51:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:51:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:51:21 devstack cinder-volume[87586]: INFO cinder.keymgr.migration [None req-fc0d0c22-c1ea-4df8-b3e6-c246c209f614 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 21:51:21 devstack sudo[87611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:51:21 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:51:21 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root Jul 07 21:51:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.627s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:51:21 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:51:21 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Driver initialization completed successfully. Jul 07 21:51:21 devstack cinder-volume[87586]: INFO cinder.manager [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Initiating service 3 cleanup Jul 07 21:51:21 devstack cinder-volume[87586]: INFO cinder.manager [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Service 3 cleanup completed. Jul 07 21:51:21 devstack cinder-volume[87586]: DEBUG cinder.service [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Creating RPC server for service cinder-volume {{(pid=87586) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 21:51:21 devstack cinder-volume[87586]: DEBUG cinder.service [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87586) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 21:51:21 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 21:51:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:51:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:51:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:51:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:51:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:51:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:51:21 devstack sudo[87632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:51:21 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:51:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.637s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:51:22 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-12bf4b2a-e82c-4bab-bbf1-056da9380c1d None None] Driver post RPC initialization completed successfully. Jul 07 21:51:22 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root Jul 07 21:51:29 devstack cinder-volume[87262]: DEBUG dbcounter [-] [87262] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87262) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:51:31 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:51:32 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=3 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:51:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:51:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 6 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 21:51:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 21:52:19 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:52:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Flow 'volume_create_manager' (90c24735-ee25-4ccb-a686-c14ddfcc5584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:52:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d54e72-6263-43d8-8f3a-2b72cd24c565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:52:20 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d54e72-6263-43d8-8f3a-2b72cd24c565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-573855710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37fbb3fc-cc53-4827-988b-14c183e2a515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c650780faa4ce9ba6a4d090caa00e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:52:20Z,use_quota=True,user_id='a2eb76d06d3f463fb4e0e0f15d570da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:52:20 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634da28d-0fd4-4522-815d-e49a3a5b5eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:52:20 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (634da28d-0fd4-4522-815d-e49a3a5b5eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:52:20 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1e1d10-a2b4-43e5-9672-1bfc2141d4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:52:20 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1e1d10-a2b4-43e5-9672-1bfc2141d4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37fbb3fc-cc53-4827-988b-14c183e2a515', 'volume_name': 'volume-37fbb3fc-cc53-4827-988b-14c183e2a515', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:52:20 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5c4e95-2370-42b8-971b-6e06a7c5e564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:52:20 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5c4e95-2370-42b8-971b-6e06a7c5e564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:52:20 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c65f26-8dbd-470f-a985-23adf35aa810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:52:20 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Volume 37fbb3fc-cc53-4827-988b-14c183e2a515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37fbb3fc-cc53-4827-988b-14c183e2a515', 'volume_size': 1} Jul 07 21:52:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:52:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:52:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-573855710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37fbb3fc-cc53-4827-988b-14c183e2a515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97c650780faa4ce9ba6a4d090caa00e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:52:20Z,use_quota=True,user_id='a2eb76d06d3f463fb4e0e0f15d570da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:52:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Creating volume 37fbb3fc-cc53-4827-988b-14c183e2a515 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:52:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:52:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:52:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:52:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:52:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:52:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:52:20 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:52:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37fbb3fc-cc53-4827-988b-14c183e2a515 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:52:20 devstack sudo[87824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37fbb3fc-cc53-4827-988b-14c183e2a515 1073741824 Jul 07 21:52:20 devstack sudo[87824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:52:21 devstack sudo[87824]: pam_unix(sudo:session): session closed for user root Jul 07 21:52:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37fbb3fc-cc53-4827-988b-14c183e2a515 1073741824" returned: 0 in 1.294s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:52:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37fbb3fc-cc53-4827-988b-14c183e2a515 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:52:21 devstack sudo[88163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37fbb3fc-cc53-4827-988b-14c183e2a515 Jul 07 21:52:21 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:52:22 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root Jul 07 21:52:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37fbb3fc-cc53-4827-988b-14c183e2a515" returned: 0 in 0.766s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:52:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] <== create_volume: return (2126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:52:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.129s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:52:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c65f26-8dbd-470f-a985-23adf35aa810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37fbb3fc-cc53-4827-988b-14c183e2a515', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:52:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5229f4ec-84ca-4c0a-a725-13ac9e0d82ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:52:22 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Volume volume-37fbb3fc-cc53-4827-988b-14c183e2a515 (37fbb3fc-cc53-4827-988b-14c183e2a515): created successfully Jul 07 21:52:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5229f4ec-84ca-4c0a-a725-13ac9e0d82ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:52:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Flow 'volume_create_manager' (90c24735-ee25-4ccb-a686-c14ddfcc5584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:52:22 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-69f76cde-84c4-4883-bce2-4168882ea0db tempest-TaggedAttachmentsTest-1854521584 None] Created volume successfully. Jul 07 21:52:32 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:52:32 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:52:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:52:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:52:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:52:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:52:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:52:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:52:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:52:35 devstack sudo[88301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:52:35 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:52:36 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root Jul 07 21:52:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.402s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:52:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:52:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:52:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 6 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 21:52:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 21:52:55 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:52:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Flow 'volume_create_manager' (9b9e23ee-734a-4685-b52e-ce0644948274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:52:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0728c2cd-2536-4ae5-96ce-3f3b36e1cea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:52:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0728c2cd-2536-4ae5-96ce-3f3b36e1cea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1088956739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=322396c9-e2d5-4d7c-992e-596566d494b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c9108418dd42879417644cc9b8eea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:52:56Z,use_quota=True,user_id='482df1bcb4134aae8b7e157fe71bcf53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:52:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c664f7bd-f0f7-4e83-bc7a-8761f359b934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:52:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c664f7bd-f0f7-4e83-bc7a-8761f359b934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:52:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115d9732-ca54-4793-9a9b-f7bb1c093bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:52:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115d9732-ca54-4793-9a9b-f7bb1c093bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '322396c9-e2d5-4d7c-992e-596566d494b6', 'volume_name': 'volume-322396c9-e2d5-4d7c-992e-596566d494b6', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:52:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40fa92c-5168-408f-a0db-4d0aca2ccee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:52:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40fa92c-5168-408f-a0db-4d0aca2ccee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:52:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3f8580-be74-4148-967f-d1f9ece99029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:52:55 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Volume 322396c9-e2d5-4d7c-992e-596566d494b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-322396c9-e2d5-4d7c-992e-596566d494b6', 'volume_size': 1} Jul 07 21:52:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:52:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:52:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1088956739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=322396c9-e2d5-4d7c-992e-596566d494b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06c9108418dd42879417644cc9b8eea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:52:56Z,use_quota=True,user_id='482df1bcb4134aae8b7e157fe71bcf53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:52:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Creating volume 322396c9-e2d5-4d7c-992e-596566d494b6 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:52:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:52:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:52:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:52:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:52:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:52:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:52:55 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:52:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-322396c9-e2d5-4d7c-992e-596566d494b6 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:52:55 devstack sudo[88642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-322396c9-e2d5-4d7c-992e-596566d494b6 1073741824 Jul 07 21:52:55 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:52:57 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root Jul 07 21:52:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-322396c9-e2d5-4d7c-992e-596566d494b6 1073741824" returned: 0 in 2.099s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:52:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-322396c9-e2d5-4d7c-992e-596566d494b6 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:52:57 devstack sudo[88650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-322396c9-e2d5-4d7c-992e-596566d494b6 Jul 07 21:52:57 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:52:59 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root Jul 07 21:52:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-322396c9-e2d5-4d7c-992e-596566d494b6" returned: 0 in 1.619s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:52:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] <== create_volume: return (3819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:52:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.827s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:52:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3f8580-be74-4148-967f-d1f9ece99029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-322396c9-e2d5-4d7c-992e-596566d494b6', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:52:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b10769-22f5-413e-b630-437e0d77b672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:52:59 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Volume volume-322396c9-e2d5-4d7c-992e-596566d494b6 (322396c9-e2d5-4d7c-992e-596566d494b6): created successfully Jul 07 21:52:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b10769-22f5-413e-b630-437e0d77b672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:52:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Flow 'volume_create_manager' (9b9e23ee-734a-4685-b52e-ce0644948274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:52:59 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-b0ca0577-b954-418f-b47b-e0a6c4a18b94 tempest-VolumesAdminNegativeTest-678837329 None] Created volume successfully. Jul 07 21:53:01 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] Acquiring lock "cinder-322396c9-e2d5-4d7c-992e-596566d494b6-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:53:01 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] Lock "cinder-322396c9-e2d5-4d7c-992e-596566d494b6-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:53:01 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] Acquiring lock "cinder-quobyte-322396c9-e2d5-4d7c-992e-596566d494b6" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:53:01 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] Lock "cinder-quobyte-322396c9-e2d5-4d7c-992e-596566d494b6" acquired by "delete_volume" :: waited 0.034s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:53:01 devstack cinder-volume[87586]: INFO oslo.privsep.daemon [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpgof3shq4/privsep.sock'] Jul 07 21:53:01 devstack sudo[88658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpgof3shq4/privsep.sock Jul 07 21:53:01 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:53:02 devstack cinder-volume[87586]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 07 21:53:02 devstack cinder-volume[87586]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 21:53:02 devstack cinder-volume[87586]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 21:53:02 devstack cinder-volume[87586]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 21:53:02 devstack cinder-volume[87586]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 21:53:02 devstack cinder-volume[87586]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 21:53:02 devstack cinder-volume[87586]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 21:53:02 devstack cinder-volume[87586]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 21:53:02 devstack cinder-volume[87586]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 07 21:53:03 devstack cinder-volume[87586]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 07 21:53:03 devstack cinder-volume[87586]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 21:53:03 devstack cinder-volume[87586]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 21:53:03 devstack cinder-volume[87586]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 21:53:03 devstack cinder-volume[87586]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 21:53:03 devstack cinder-volume[87586]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 21:53:03 devstack cinder-volume[87586]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 21:53:03 devstack cinder-volume[87586]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 21:53:03 devstack cinder-volume[87586]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 07 21:53:04 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root Jul 07 21:53:04 devstack cinder-volume[87586]: INFO oslo.privsep.daemon [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] Spawned new privsep daemon via rootwrap Jul 07 21:53:04 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] Accepted privsep connection to /tmp/tmpgof3shq4/privsep.sock {{(pid=87586) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 07 21:53:04 devstack cinder-volume[87586]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 07 21:53:04 devstack cinder-volume[87586]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 07 21:53:04 devstack cinder-volume[87586]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 07 21:53:04 devstack cinder-volume[87586]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88661 Jul 07 21:53:04 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea311e87-5b06-44d8-b3ce-34008f6e60e4]: (2,) {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:53:04 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b336b1-b1db-4e3b-b7bb-b62887ff8dd0]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:53:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-322396c9-e2d5-4d7c-992e-596566d494b6 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:53:04 devstack sudo[88663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-322396c9-e2d5-4d7c-992e-596566d494b6 Jul 07 21:53:04 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:53:06 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root Jul 07 21:53:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-322396c9-e2d5-4d7c-992e-596566d494b6" returned: 0 in 1.860s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:53:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-322396c9-e2d5-4d7c-992e-596566d494b6 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:53:06 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-322396c9-e2d5-4d7c-992e-596566d494b6 Jul 07 21:53:06 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:53:07 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Jul 07 21:53:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-322396c9-e2d5-4d7c-992e-596566d494b6" returned: 0 in 1.498s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:53:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] Lock "cinder-quobyte-322396c9-e2d5-4d7c-992e-596566d494b6" released by "delete_volume" :: held 6.244s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:53:07 devstack cinder-volume[87586]: WARNING cinder.quota [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 21:53:07 devstack cinder-volume[87586]: WARNING cinder.quota [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 21:53:07 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] Created reservations ['4c8fb2b7-9a32-4846-8d1a-fb26be4bef5e', '1b722ad2-3127-45c1-bb53-f008ebb1e86d', 'f44b66b6-7bf8-46cd-a1af-15abcb8ad563', 'e4d85352-f25c-4200-8eb9-88b2894ab7ee'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:53:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:53:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:53:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:53:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:53:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:53:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:53:08 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:53:08 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:53:09 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Jul 07 21:53:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.337s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:53:09 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:53:09 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] Deleted volume successfully. Jul 07 21:53:09 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-893d3969-9566-4a42-b588-6fa2a60367fc tempest-VolumesAdminNegativeTest-678837329 None] Lock "cinder-322396c9-e2d5-4d7c-992e-596566d494b6-delete_volume" released by "delete_volume" :: held 8.208s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:53:17 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=9,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=3 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:53:19 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:UPDATE=11,cinder:SELECT=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:53:22 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:53:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Flow 'volume_create_manager' (868ca7b5-018f-4bba-acfe-29755ad4483f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:53:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3efcb06-810b-4321-bba5-ae5044119558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:53:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3efcb06-810b-4321-bba5-ae5044119558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1504298388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6100a92-84d7-4b1e-8f33-3775ebcf36b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7baaef8896b8436bb9f31e7fd0088288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:53:22Z,use_quota=True,user_id='af0652f709764469801c84fe86dcc2cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:53:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba9e722d-07fb-4224-bf27-8589ee96821c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:53:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba9e722d-07fb-4224-bf27-8589ee96821c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:53:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84761a55-646d-415c-95f9-62c2269110ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:53:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84761a55-646d-415c-95f9-62c2269110ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6100a92-84d7-4b1e-8f33-3775ebcf36b7', 'volume_name': 'volume-c6100a92-84d7-4b1e-8f33-3775ebcf36b7', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:53:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558d2e19-5e83-4286-a29d-b3fa5dec6aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:53:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558d2e19-5e83-4286-a29d-b3fa5dec6aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:53:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2aa905-8e9e-46f7-971d-855422d2514a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:53:22 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Volume c6100a92-84d7-4b1e-8f33-3775ebcf36b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6100a92-84d7-4b1e-8f33-3775ebcf36b7', 'volume_size': 1} Jul 07 21:53:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:53:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:53:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1504298388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6100a92-84d7-4b1e-8f33-3775ebcf36b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7baaef8896b8436bb9f31e7fd0088288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:53:22Z,use_quota=True,user_id='af0652f709764469801c84fe86dcc2cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:53:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Creating volume c6100a92-84d7-4b1e-8f33-3775ebcf36b7 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:53:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:53:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:53:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:53:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:53:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:53:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:53:22 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:53:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c6100a92-84d7-4b1e-8f33-3775ebcf36b7 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:53:22 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c6100a92-84d7-4b1e-8f33-3775ebcf36b7 1073741824 Jul 07 21:53:22 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:53:23 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Jul 07 21:53:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c6100a92-84d7-4b1e-8f33-3775ebcf36b7 1073741824" returned: 0 in 0.999s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:53:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c6100a92-84d7-4b1e-8f33-3775ebcf36b7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:53:23 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c6100a92-84d7-4b1e-8f33-3775ebcf36b7 Jul 07 21:53:23 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:53:24 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Jul 07 21:53:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c6100a92-84d7-4b1e-8f33-3775ebcf36b7" returned: 0 in 0.726s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:53:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:53:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:53:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2aa905-8e9e-46f7-971d-855422d2514a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6100a92-84d7-4b1e-8f33-3775ebcf36b7', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:53:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec1962c-33ec-4284-8d1e-2d6957113da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:53:24 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Volume volume-c6100a92-84d7-4b1e-8f33-3775ebcf36b7 (c6100a92-84d7-4b1e-8f33-3775ebcf36b7): created successfully Jul 07 21:53:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec1962c-33ec-4284-8d1e-2d6957113da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:53:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Flow 'volume_create_manager' (868ca7b5-018f-4bba-acfe-29755ad4483f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:53:24 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-aa58abd0-792d-4bcc-b234-c78882026629 tempest-ServersNegativeTestJSON-1256144019 None] Created volume successfully. Jul 07 21:53:28 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:53:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Flow 'volume_create_manager' (5e4821d4-fd5d-4000-8952-4b88d1e23c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:53:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69dff2ab-97ab-4472-892d-8ef998721107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:53:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69dff2ab-97ab-4472-892d-8ef998721107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-158891890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7baaef8896b8436bb9f31e7fd0088288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:53:29Z,use_quota=True,user_id='af0652f709764469801c84fe86dcc2cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:53:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7519e29e-54b1-450e-a8f3-cb4e98ecea64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:53:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7519e29e-54b1-450e-a8f3-cb4e98ecea64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:53:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e948988f-5e75-4b95-8ecd-7fdf0c59141f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:53:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e948988f-5e75-4b95-8ecd-7fdf0c59141f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d', 'volume_name': 'volume-5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:53:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ad863f-1999-4eab-9373-319ec4a226bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:53:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ad863f-1999-4eab-9373-319ec4a226bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:53:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06d711b-c0d5-421b-a327-3b1c5cabd303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:53:28 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Volume 5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d', 'volume_size': 1} Jul 07 21:53:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:53:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:53:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-158891890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7baaef8896b8436bb9f31e7fd0088288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:53:29Z,use_quota=True,user_id='af0652f709764469801c84fe86dcc2cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:53:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Creating volume 5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:53:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:53:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:53:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:53:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:53:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:53:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:53:28 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:53:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:53:28 devstack sudo[88951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d 1073741824 Jul 07 21:53:28 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:53:29 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root Jul 07 21:53:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d 1073741824" returned: 0 in 1.086s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:53:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:53:29 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d Jul 07 21:53:29 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:53:31 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Jul 07 21:53:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d" returned: 0 in 1.302s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:53:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] <== create_volume: return (2450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:53:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.452s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:53:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06d711b-c0d5-421b-a327-3b1c5cabd303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:53:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6539f2d4-db72-4dc6-821d-08d20847046d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:53:31 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Volume volume-5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d (5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d): created successfully Jul 07 21:53:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6539f2d4-db72-4dc6-821d-08d20847046d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:53:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Flow 'volume_create_manager' (5e4821d4-fd5d-4000-8952-4b88d1e23c0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:53:31 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-b1a71783-2bfd-407a-88e9-42111b96530e tempest-ServersNegativeTestJSON-1256144019 None] Created volume successfully. Jul 07 21:53:32 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7ba4bf72-394d-4eb6-808f-1f84bfbbead5 tempest-ServersNegativeTestJSON-1256144019 None] Acquiring lock "cinder-5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:53:32 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7ba4bf72-394d-4eb6-808f-1f84bfbbead5 tempest-ServersNegativeTestJSON-1256144019 None] Lock "cinder-5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:53:32 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7ba4bf72-394d-4eb6-808f-1f84bfbbead5 tempest-ServersNegativeTestJSON-1256144019 None] Acquiring lock "cinder-quobyte-5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:53:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7ba4bf72-394d-4eb6-808f-1f84bfbbead5 tempest-ServersNegativeTestJSON-1256144019 None] Lock "cinder-quobyte-5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d" acquired by "delete_volume" :: waited 0.057s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:53:33 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e57c446-6704-4f18-a584-eb74462a29b0]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:53:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7ba4bf72-394d-4eb6-808f-1f84bfbbead5 tempest-ServersNegativeTestJSON-1256144019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:53:33 devstack sudo[89049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d Jul 07 21:53:33 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:53:33 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root Jul 07 21:53:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7ba4bf72-394d-4eb6-808f-1f84bfbbead5 tempest-ServersNegativeTestJSON-1256144019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d" returned: 0 in 0.876s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:53:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7ba4bf72-394d-4eb6-808f-1f84bfbbead5 tempest-ServersNegativeTestJSON-1256144019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:53:33 devstack sudo[89063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d Jul 07 21:53:33 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:53:34 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root Jul 07 21:53:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7ba4bf72-394d-4eb6-808f-1f84bfbbead5 tempest-ServersNegativeTestJSON-1256144019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d" returned: 0 in 0.770s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:53:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7ba4bf72-394d-4eb6-808f-1f84bfbbead5 tempest-ServersNegativeTestJSON-1256144019 None] Lock "cinder-quobyte-5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d" released by "delete_volume" :: held 1.709s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:53:34 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-7ba4bf72-394d-4eb6-808f-1f84bfbbead5 tempest-ServersNegativeTestJSON-1256144019 None] Created reservations ['c0e0a10d-5106-4c62-92ff-a74409408b98', '71dd99cf-e55f-4d78-886f-36571cfba8e1', 'd7cc3be8-d6fa-4593-bee9-4c054c50229a', '9f2b3c64-8340-46ad-9677-daefb6fdcbd4'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:53:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7ba4bf72-394d-4eb6-808f-1f84bfbbead5 tempest-ServersNegativeTestJSON-1256144019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:53:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7ba4bf72-394d-4eb6-808f-1f84bfbbead5 tempest-ServersNegativeTestJSON-1256144019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:53:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7ba4bf72-394d-4eb6-808f-1f84bfbbead5 tempest-ServersNegativeTestJSON-1256144019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:53:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7ba4bf72-394d-4eb6-808f-1f84bfbbead5 tempest-ServersNegativeTestJSON-1256144019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:53:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7ba4bf72-394d-4eb6-808f-1f84bfbbead5 tempest-ServersNegativeTestJSON-1256144019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:53:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7ba4bf72-394d-4eb6-808f-1f84bfbbead5 tempest-ServersNegativeTestJSON-1256144019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:53:34 devstack sudo[89083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:53:34 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:53:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f476885d-30de-45b3-855c-e8c9f39b3748 tempest-ServersNegativeTestJSON-1256144019 None] Acquiring lock "cinder-c6100a92-84d7-4b1e-8f33-3775ebcf36b7-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:53:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f476885d-30de-45b3-855c-e8c9f39b3748 tempest-ServersNegativeTestJSON-1256144019 None] Lock "cinder-c6100a92-84d7-4b1e-8f33-3775ebcf36b7-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:53:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f476885d-30de-45b3-855c-e8c9f39b3748 tempest-ServersNegativeTestJSON-1256144019 None] Acquiring lock "cinder-quobyte-c6100a92-84d7-4b1e-8f33-3775ebcf36b7" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:53:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f476885d-30de-45b3-855c-e8c9f39b3748 tempest-ServersNegativeTestJSON-1256144019 None] Lock "cinder-quobyte-c6100a92-84d7-4b1e-8f33-3775ebcf36b7" acquired by "delete_volume" :: waited 0.031s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:53:35 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2eb6878-e325-4edb-8b86-204afdb7d94a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:53:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f476885d-30de-45b3-855c-e8c9f39b3748 tempest-ServersNegativeTestJSON-1256144019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c6100a92-84d7-4b1e-8f33-3775ebcf36b7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:53:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:53:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:53:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:53:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:53:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:53:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:53:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:53:35 devstack sudo[89094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c6100a92-84d7-4b1e-8f33-3775ebcf36b7 Jul 07 21:53:35 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:53:35 devstack sudo[89096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:53:35 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:53:36 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root Jul 07 21:53:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7ba4bf72-394d-4eb6-808f-1f84bfbbead5 tempest-ServersNegativeTestJSON-1256144019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.124s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:53:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-7ba4bf72-394d-4eb6-808f-1f84bfbbead5 tempest-ServersNegativeTestJSON-1256144019 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:53:36 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-7ba4bf72-394d-4eb6-808f-1f84bfbbead5 tempest-ServersNegativeTestJSON-1256144019 None] Deleted volume successfully. Jul 07 21:53:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7ba4bf72-394d-4eb6-808f-1f84bfbbead5 tempest-ServersNegativeTestJSON-1256144019 None] Lock "cinder-5ec3fc5a-4030-43b9-89fc-29dedcb2cb1d-delete_volume" released by "delete_volume" :: held 3.272s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:53:36 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root Jul 07 21:53:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.009s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:53:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:53:36 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root Jul 07 21:53:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f476885d-30de-45b3-855c-e8c9f39b3748 tempest-ServersNegativeTestJSON-1256144019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c6100a92-84d7-4b1e-8f33-3775ebcf36b7" returned: 0 in 1.353s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:53:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f476885d-30de-45b3-855c-e8c9f39b3748 tempest-ServersNegativeTestJSON-1256144019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c6100a92-84d7-4b1e-8f33-3775ebcf36b7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:53:36 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c6100a92-84d7-4b1e-8f33-3775ebcf36b7 Jul 07 21:53:36 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:53:37 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Jul 07 21:53:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f476885d-30de-45b3-855c-e8c9f39b3748 tempest-ServersNegativeTestJSON-1256144019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c6100a92-84d7-4b1e-8f33-3775ebcf36b7" returned: 0 in 0.747s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:53:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f476885d-30de-45b3-855c-e8c9f39b3748 tempest-ServersNegativeTestJSON-1256144019 None] Lock "cinder-quobyte-c6100a92-84d7-4b1e-8f33-3775ebcf36b7" released by "delete_volume" :: held 2.154s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:53:37 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-f476885d-30de-45b3-855c-e8c9f39b3748 tempest-ServersNegativeTestJSON-1256144019 None] Created reservations ['1b81a641-85d0-4ee5-a704-1247c0a465de', '8812a373-245b-4891-9fbd-6c4679e40e14', '220856b0-9d1d-4e61-990c-f7232f85c1d5', '3615f31c-d69d-406a-92e2-198558851bbf'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:53:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f476885d-30de-45b3-855c-e8c9f39b3748 tempest-ServersNegativeTestJSON-1256144019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:53:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f476885d-30de-45b3-855c-e8c9f39b3748 tempest-ServersNegativeTestJSON-1256144019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:53:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f476885d-30de-45b3-855c-e8c9f39b3748 tempest-ServersNegativeTestJSON-1256144019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:53:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f476885d-30de-45b3-855c-e8c9f39b3748 tempest-ServersNegativeTestJSON-1256144019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:53:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f476885d-30de-45b3-855c-e8c9f39b3748 tempest-ServersNegativeTestJSON-1256144019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:53:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f476885d-30de-45b3-855c-e8c9f39b3748 tempest-ServersNegativeTestJSON-1256144019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:53:37 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:53:37 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:53:38 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Jul 07 21:53:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f476885d-30de-45b3-855c-e8c9f39b3748 tempest-ServersNegativeTestJSON-1256144019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.983s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:53:38 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-f476885d-30de-45b3-855c-e8c9f39b3748 tempest-ServersNegativeTestJSON-1256144019 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:53:38 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-f476885d-30de-45b3-855c-e8c9f39b3748 tempest-ServersNegativeTestJSON-1256144019 None] Deleted volume successfully. Jul 07 21:53:38 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f476885d-30de-45b3-855c-e8c9f39b3748 tempest-ServersNegativeTestJSON-1256144019 None] Lock "cinder-c6100a92-84d7-4b1e-8f33-3775ebcf36b7-delete_volume" released by "delete_volume" :: held 3.619s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:53:42 devstack cinder-volume[87586]: WARNING py.warnings [req-7e4266ce-6ac8-4983-bc79-c81bf993feee req-1c46112b-bdd3-4089-b82f-07749da0108a tempest-TaggedAttachmentsTest-1854521584 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 07 21:53:42 devstack cinder-volume[87586]: .first() Jul 07 21:53:42 devstack cinder-volume[87586]: Jul 07 21:53:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-7e4266ce-6ac8-4983-bc79-c81bf993feee req-1c46112b-bdd3-4089-b82f-07749da0108a tempest-TaggedAttachmentsTest-1854521584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:53:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-7e4266ce-6ac8-4983-bc79-c81bf993feee req-1c46112b-bdd3-4089-b82f-07749da0108a tempest-TaggedAttachmentsTest-1854521584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:53:42 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f21459-20e1-4332-a25b-fd994f78e655]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:53:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-7e4266ce-6ac8-4983-bc79-c81bf993feee req-1c46112b-bdd3-4089-b82f-07749da0108a tempest-TaggedAttachmentsTest-1854521584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37fbb3fc-cc53-4827-988b-14c183e2a515 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:53:42 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37fbb3fc-cc53-4827-988b-14c183e2a515 Jul 07 21:53:42 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:53:43 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Jul 07 21:53:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-7e4266ce-6ac8-4983-bc79-c81bf993feee req-1c46112b-bdd3-4089-b82f-07749da0108a tempest-TaggedAttachmentsTest-1854521584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37fbb3fc-cc53-4827-988b-14c183e2a515" returned: 0 in 0.979s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:53:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-7e4266ce-6ac8-4983-bc79-c81bf993feee req-1c46112b-bdd3-4089-b82f-07749da0108a tempest-TaggedAttachmentsTest-1854521584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:53:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-7e4266ce-6ac8-4983-bc79-c81bf993feee req-1c46112b-bdd3-4089-b82f-07749da0108a tempest-TaggedAttachmentsTest-1854521584 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491', 'name': 'volume-37fbb3fc-cc53-4827-988b-14c183e2a515', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6e467042-3e2e-4776-ae2a-5d97a3f83103', 'enforce_multipath': True} {{(pid=87586) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4930}} Jul 07 21:53:43 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-7e4266ce-6ac8-4983-bc79-c81bf993feee req-1c46112b-bdd3-4089-b82f-07749da0108a tempest-TaggedAttachmentsTest-1854521584 None] attachment_update completed successfully. Jul 07 21:53:52 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-33d51a93-f19e-4494-b372-78341f862c24 req-a67a86ac-e529-4621-861b-e1c46d956586 tempest-TaggedAttachmentsTest-1854521584 None] Terminate volume connection completed successfully. Jul 07 21:53:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-33d51a93-f19e-4494-b372-78341f862c24 req-a67a86ac-e529-4621-861b-e1c46d956586 tempest-TaggedAttachmentsTest-1854521584 None] Deleting attachment 6e467042-3e2e-4776-ae2a-5d97a3f83103. {{(pid=87586) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 07 21:53:53 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:UPDATE=26,cinder:SELECT=20,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:54:02 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:54:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Flow 'volume_create_manager' (49574b71-ceba-4a70-afb0-4a59c5bc05d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:54:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0e2739-9e6e-4376-8540-fa593b9e723c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0e2739-9e6e-4376-8540-fa593b9e723c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1183625691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2553286d-cd27-4001-b6f2-0d47d24de889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d112b262c9d04c98ae9dc86c62e3c552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:54:02Z,use_quota=True,user_id='0dfbc95c3a27493d96570ba805a6825b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dac0c74-6438-4f7b-81a6-95dfe7c90668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dac0c74-6438-4f7b-81a6-95dfe7c90668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123414e7-0540-465a-92c6-a8d745a4fafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123414e7-0540-465a-92c6-a8d745a4fafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2553286d-cd27-4001-b6f2-0d47d24de889', 'volume_name': 'volume-2553286d-cd27-4001-b6f2-0d47d24de889', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (877135d3-1721-4aea-8417-65a183cdb3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (877135d3-1721-4aea-8417-65a183cdb3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7a48ea-78f9-4641-b8f5-c87d473707fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:02 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Volume 2553286d-cd27-4001-b6f2-0d47d24de889: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2553286d-cd27-4001-b6f2-0d47d24de889', 'volume_size': 1} Jul 07 21:54:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:54:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:54:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1183625691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2553286d-cd27-4001-b6f2-0d47d24de889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d112b262c9d04c98ae9dc86c62e3c552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:54:02Z,use_quota=True,user_id='0dfbc95c3a27493d96570ba805a6825b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:54:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Creating volume 2553286d-cd27-4001-b6f2-0d47d24de889 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:54:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:54:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:54:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:54:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:54:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:54:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:54:02 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:54:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2553286d-cd27-4001-b6f2-0d47d24de889 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:02 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2553286d-cd27-4001-b6f2-0d47d24de889 1073741824 Jul 07 21:54:02 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:03 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2553286d-cd27-4001-b6f2-0d47d24de889 1073741824" returned: 0 in 1.112s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2553286d-cd27-4001-b6f2-0d47d24de889 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:03 devstack sudo[89664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2553286d-cd27-4001-b6f2-0d47d24de889 Jul 07 21:54:03 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:04 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2553286d-cd27-4001-b6f2-0d47d24de889" returned: 0 in 0.962s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:04 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] <== create_volume: return (2137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:54:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.140s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:54:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7a48ea-78f9-4641-b8f5-c87d473707fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2553286d-cd27-4001-b6f2-0d47d24de889', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7977fb-df8a-45ad-b355-d2732b5774ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:04 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Volume volume-2553286d-cd27-4001-b6f2-0d47d24de889 (2553286d-cd27-4001-b6f2-0d47d24de889): created successfully Jul 07 21:54:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7977fb-df8a-45ad-b355-d2732b5774ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Flow 'volume_create_manager' (49574b71-ceba-4a70-afb0-4a59c5bc05d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:54:04 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-7b204e60-0afd-45f3-bf07-74fad9ba8cb5 tempest-ServerActionsTestOtherA-1059080414 None] Created volume successfully. Jul 07 21:54:14 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=23,cinder:UPDATE=25,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:54:14 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:54:15 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:54:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Flow 'volume_create_manager' (433ee6c4-c4e0-4268-a032-fd4046b9d85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:54:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad6212f-ee1e-4607-9aab-0fabda7ea5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad6212f-ee1e-4607-9aab-0fabda7ea5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-572063611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7269f678-df5a-4716-a758-9090460e7959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfc2d7e366c406893b5e3507663169e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:54:15Z,use_quota=True,user_id='a6e82688e1e44c8184e40a77266c71d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62081cd2-2ef2-4969-9458-f18430c86e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62081cd2-2ef2-4969-9458-f18430c86e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae13f010-7721-4b62-a9a3-95475ad5d1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae13f010-7721-4b62-a9a3-95475ad5d1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7269f678-df5a-4716-a758-9090460e7959', 'volume_name': 'volume-7269f678-df5a-4716-a758-9090460e7959', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83cdeba3-ffe2-40e3-8bbc-6a93c80a3851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83cdeba3-ffe2-40e3-8bbc-6a93c80a3851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa26896-83c5-4115-97a1-6ea749ad4eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:15 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Volume 7269f678-df5a-4716-a758-9090460e7959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7269f678-df5a-4716-a758-9090460e7959', 'volume_size': 1} Jul 07 21:54:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:54:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:54:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-572063611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7269f678-df5a-4716-a758-9090460e7959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cfc2d7e366c406893b5e3507663169e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:54:15Z,use_quota=True,user_id='a6e82688e1e44c8184e40a77266c71d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:54:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Creating volume 7269f678-df5a-4716-a758-9090460e7959 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:54:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:54:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:54:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:54:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:54:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:54:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:54:15 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:54:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7269f678-df5a-4716-a758-9090460e7959 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:15 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7269f678-df5a-4716-a758-9090460e7959 1073741824 Jul 07 21:54:15 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:16 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7269f678-df5a-4716-a758-9090460e7959 1073741824" returned: 0 in 1.352s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7269f678-df5a-4716-a758-9090460e7959 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:17 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7269f678-df5a-4716-a758-9090460e7959 Jul 07 21:54:17 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f26df854-19da-4c33-9d18-8147cba86d6d tempest-TaggedAttachmentsTest-1854521584 None] Acquiring lock "cinder-37fbb3fc-cc53-4827-988b-14c183e2a515-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:54:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f26df854-19da-4c33-9d18-8147cba86d6d tempest-TaggedAttachmentsTest-1854521584 None] Lock "cinder-37fbb3fc-cc53-4827-988b-14c183e2a515-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:54:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f26df854-19da-4c33-9d18-8147cba86d6d tempest-TaggedAttachmentsTest-1854521584 None] Acquiring lock "cinder-quobyte-37fbb3fc-cc53-4827-988b-14c183e2a515" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:54:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f26df854-19da-4c33-9d18-8147cba86d6d tempest-TaggedAttachmentsTest-1854521584 None] Lock "cinder-quobyte-37fbb3fc-cc53-4827-988b-14c183e2a515" acquired by "delete_volume" :: waited 0.059s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:54:18 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[72454e83-9e1a-4525-a14d-b2024f74a020]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:54:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f26df854-19da-4c33-9d18-8147cba86d6d tempest-TaggedAttachmentsTest-1854521584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37fbb3fc-cc53-4827-988b-14c183e2a515 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:18 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7269f678-df5a-4716-a758-9090460e7959" returned: 0 in 1.333s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] <== create_volume: return (2773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:54:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.776s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:54:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa26896-83c5-4115-97a1-6ea749ad4eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7269f678-df5a-4716-a758-9090460e7959', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150856b8-2f9f-4883-84cc-5f792ebfb917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:18 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Volume volume-7269f678-df5a-4716-a758-9090460e7959 (7269f678-df5a-4716-a758-9090460e7959): created successfully Jul 07 21:54:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150856b8-2f9f-4883-84cc-5f792ebfb917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Flow 'volume_create_manager' (433ee6c4-c4e0-4268-a032-fd4046b9d85d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:54:18 devstack sudo[89806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37fbb3fc-cc53-4827-988b-14c183e2a515 Jul 07 21:54:18 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:18 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-a1cbab8c-ce53-48bf-aa75-031c180cc89d tempest-DeleteServersTestJSON-1179632775 None] Created volume successfully. Jul 07 21:54:19 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f26df854-19da-4c33-9d18-8147cba86d6d tempest-TaggedAttachmentsTest-1854521584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37fbb3fc-cc53-4827-988b-14c183e2a515" returned: 0 in 1.166s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f26df854-19da-4c33-9d18-8147cba86d6d tempest-TaggedAttachmentsTest-1854521584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37fbb3fc-cc53-4827-988b-14c183e2a515 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:19 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37fbb3fc-cc53-4827-988b-14c183e2a515 Jul 07 21:54:19 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:20 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f26df854-19da-4c33-9d18-8147cba86d6d tempest-TaggedAttachmentsTest-1854521584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37fbb3fc-cc53-4827-988b-14c183e2a515" returned: 0 in 1.243s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f26df854-19da-4c33-9d18-8147cba86d6d tempest-TaggedAttachmentsTest-1854521584 None] Lock "cinder-quobyte-37fbb3fc-cc53-4827-988b-14c183e2a515" released by "delete_volume" :: held 2.483s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:54:20 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-f26df854-19da-4c33-9d18-8147cba86d6d tempest-TaggedAttachmentsTest-1854521584 None] Created reservations ['9f113705-c6f2-4ff3-8b42-75214c1bf1cb', 'a7bc3e31-409c-4d82-9bfb-a83595911ab0', 'fbb76b07-aa77-489e-93ac-022ac34646d4', 'f3f42732-b964-409e-b8c1-0552eec308a1'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:54:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f26df854-19da-4c33-9d18-8147cba86d6d tempest-TaggedAttachmentsTest-1854521584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:54:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f26df854-19da-4c33-9d18-8147cba86d6d tempest-TaggedAttachmentsTest-1854521584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:54:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f26df854-19da-4c33-9d18-8147cba86d6d tempest-TaggedAttachmentsTest-1854521584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:54:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f26df854-19da-4c33-9d18-8147cba86d6d tempest-TaggedAttachmentsTest-1854521584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:54:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f26df854-19da-4c33-9d18-8147cba86d6d tempest-TaggedAttachmentsTest-1854521584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:54:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f26df854-19da-4c33-9d18-8147cba86d6d tempest-TaggedAttachmentsTest-1854521584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:21 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:54:21 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:22 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f26df854-19da-4c33-9d18-8147cba86d6d tempest-TaggedAttachmentsTest-1854521584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.029s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:22 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-f26df854-19da-4c33-9d18-8147cba86d6d tempest-TaggedAttachmentsTest-1854521584 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:54:22 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-f26df854-19da-4c33-9d18-8147cba86d6d tempest-TaggedAttachmentsTest-1854521584 None] Deleted volume successfully. Jul 07 21:54:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f26df854-19da-4c33-9d18-8147cba86d6d tempest-TaggedAttachmentsTest-1854521584 None] Lock "cinder-37fbb3fc-cc53-4827-988b-14c183e2a515-delete_volume" released by "delete_volume" :: held 4.056s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:54:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-0a853693-fc00-44e6-a639-9a96bf21bcc3 req-8a130519-0797-40f2-8485-7b248b2a677a tempest-DeleteServersTestJSON-1179632775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:54:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-0a853693-fc00-44e6-a639-9a96bf21bcc3 req-8a130519-0797-40f2-8485-7b248b2a677a tempest-DeleteServersTestJSON-1179632775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:54:22 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b48ef1-89fd-4595-9504-1ce5e506a1c6]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:54:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-0a853693-fc00-44e6-a639-9a96bf21bcc3 req-8a130519-0797-40f2-8485-7b248b2a677a tempest-DeleteServersTestJSON-1179632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7269f678-df5a-4716-a758-9090460e7959 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:22 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7269f678-df5a-4716-a758-9090460e7959 Jul 07 21:54:22 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:24 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-0a853693-fc00-44e6-a639-9a96bf21bcc3 req-8a130519-0797-40f2-8485-7b248b2a677a tempest-DeleteServersTestJSON-1179632775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7269f678-df5a-4716-a758-9090460e7959" returned: 0 in 1.857s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-0a853693-fc00-44e6-a639-9a96bf21bcc3 req-8a130519-0797-40f2-8485-7b248b2a677a tempest-DeleteServersTestJSON-1179632775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.887s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:54:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-0a853693-fc00-44e6-a639-9a96bf21bcc3 req-8a130519-0797-40f2-8485-7b248b2a677a tempest-DeleteServersTestJSON-1179632775 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491', 'name': 'volume-7269f678-df5a-4716-a758-9090460e7959', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a245d45-7f73-4ee3-a53a-a8982acb4d5a', 'enforce_multipath': True} {{(pid=87586) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4930}} Jul 07 21:54:24 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-0a853693-fc00-44e6-a639-9a96bf21bcc3 req-8a130519-0797-40f2-8485-7b248b2a677a tempest-DeleteServersTestJSON-1179632775 None] attachment_update completed successfully. Jul 07 21:54:34 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=11,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:54:34 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=14,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:54:35 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-4a501c75-ef4c-4ec0-9dde-416594a00c6a req-b248fe44-d8ef-4c5a-9f72-62d9bc316b1f tempest-DeleteServersTestJSON-1179632775 None] Terminate volume connection completed successfully. Jul 07 21:54:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-4a501c75-ef4c-4ec0-9dde-416594a00c6a req-b248fe44-d8ef-4c5a-9f72-62d9bc316b1f tempest-DeleteServersTestJSON-1179632775 None] Deleting attachment 3a245d45-7f73-4ee3-a53a-a8982acb4d5a. {{(pid=87586) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 07 21:54:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:54:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:54:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:54:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:54:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:54:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:54:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:35 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:54:35 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:36 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.115s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:54:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:54:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 8 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 21:54:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 21:54:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f638976b-e33a-4b9e-9c90-cc3af5dfed91 tempest-DeleteServersTestJSON-1179632775 None] Acquiring lock "cinder-7269f678-df5a-4716-a758-9090460e7959-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:54:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f638976b-e33a-4b9e-9c90-cc3af5dfed91 tempest-DeleteServersTestJSON-1179632775 None] Lock "cinder-7269f678-df5a-4716-a758-9090460e7959-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:54:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f638976b-e33a-4b9e-9c90-cc3af5dfed91 tempest-DeleteServersTestJSON-1179632775 None] Acquiring lock "cinder-quobyte-7269f678-df5a-4716-a758-9090460e7959" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:54:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f638976b-e33a-4b9e-9c90-cc3af5dfed91 tempest-DeleteServersTestJSON-1179632775 None] Lock "cinder-quobyte-7269f678-df5a-4716-a758-9090460e7959" acquired by "delete_volume" :: waited 0.022s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:54:39 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[934f882d-6b1d-4ebb-bded-1f6642a1890d]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:54:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f638976b-e33a-4b9e-9c90-cc3af5dfed91 tempest-DeleteServersTestJSON-1179632775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7269f678-df5a-4716-a758-9090460e7959 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:40 devstack sudo[90541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7269f678-df5a-4716-a758-9090460e7959 Jul 07 21:54:40 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Flow 'volume_create_manager' (7353066c-f8d7-4d75-a486-4580e226cd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c178cb-cf6d-486b-87a9-f2ad74cdea42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c178cb-cf6d-486b-87a9-f2ad74cdea42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1121810675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea874ae-94ce-4428-8703-b0771b086323,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='895b28343adc4f8a86422f1e2aab6c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:54:40Z,use_quota=True,user_id='0e3ffd3ae8cb48df845df501feedef97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bcbb339-8858-4b8c-8bf8-99d4d834ad8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bcbb339-8858-4b8c-8bf8-99d4d834ad8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f425f53e-2014-411a-a93e-efd17230c7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f425f53e-2014-411a-a93e-efd17230c7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aea874ae-94ce-4428-8703-b0771b086323', 'volume_name': 'volume-aea874ae-94ce-4428-8703-b0771b086323', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f411e9-59fe-4867-a11c-0472b71501d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f411e9-59fe-4867-a11c-0472b71501d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667258d0-3527-4c1e-8ace-4126d938a599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:40 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Volume aea874ae-94ce-4428-8703-b0771b086323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aea874ae-94ce-4428-8703-b0771b086323', 'volume_size': 1} Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1121810675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea874ae-94ce-4428-8703-b0771b086323,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='895b28343adc4f8a86422f1e2aab6c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:54:40Z,use_quota=True,user_id='0e3ffd3ae8cb48df845df501feedef97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Creating volume aea874ae-94ce-4428-8703-b0771b086323 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:54:40 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-aea874ae-94ce-4428-8703-b0771b086323 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:40 devstack sudo[90544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-aea874ae-94ce-4428-8703-b0771b086323 1073741824 Jul 07 21:54:40 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:40 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f638976b-e33a-4b9e-9c90-cc3af5dfed91 tempest-DeleteServersTestJSON-1179632775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7269f678-df5a-4716-a758-9090460e7959" returned: 0 in 1.083s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f638976b-e33a-4b9e-9c90-cc3af5dfed91 tempest-DeleteServersTestJSON-1179632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7269f678-df5a-4716-a758-9090460e7959 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:40 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7269f678-df5a-4716-a758-9090460e7959 Jul 07 21:54:40 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:41 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-aea874ae-94ce-4428-8703-b0771b086323 1073741824" returned: 0 in 0.877s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-aea874ae-94ce-4428-8703-b0771b086323 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:41 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-aea874ae-94ce-4428-8703-b0771b086323 Jul 07 21:54:41 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:41 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f638976b-e33a-4b9e-9c90-cc3af5dfed91 tempest-DeleteServersTestJSON-1179632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7269f678-df5a-4716-a758-9090460e7959" returned: 0 in 0.704s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:41 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f638976b-e33a-4b9e-9c90-cc3af5dfed91 tempest-DeleteServersTestJSON-1179632775 None] Lock "cinder-quobyte-7269f678-df5a-4716-a758-9090460e7959" released by "delete_volume" :: held 1.851s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:54:41 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-f638976b-e33a-4b9e-9c90-cc3af5dfed91 tempest-DeleteServersTestJSON-1179632775 None] Created reservations ['3e715e93-84f6-4bd4-a474-49beff555366', '2f6c5b5b-4d3e-48fd-89d4-2e97b47df044', '06b18157-fc6b-4c3e-906e-dd24fdb5c4d0', 'da7132c8-37ba-4505-87fd-66c9e3da8d2c'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:54:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f638976b-e33a-4b9e-9c90-cc3af5dfed91 tempest-DeleteServersTestJSON-1179632775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:54:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f638976b-e33a-4b9e-9c90-cc3af5dfed91 tempest-DeleteServersTestJSON-1179632775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:54:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f638976b-e33a-4b9e-9c90-cc3af5dfed91 tempest-DeleteServersTestJSON-1179632775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:54:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f638976b-e33a-4b9e-9c90-cc3af5dfed91 tempest-DeleteServersTestJSON-1179632775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:54:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f638976b-e33a-4b9e-9c90-cc3af5dfed91 tempest-DeleteServersTestJSON-1179632775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:54:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f638976b-e33a-4b9e-9c90-cc3af5dfed91 tempest-DeleteServersTestJSON-1179632775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:41 devstack sudo[90559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:54:41 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:42 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-aea874ae-94ce-4428-8703-b0771b086323" returned: 0 in 0.687s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:54:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:54:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667258d0-3527-4c1e-8ace-4126d938a599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aea874ae-94ce-4428-8703-b0771b086323', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034beae1-6f1b-491a-8a9f-4c5663f0c80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:42 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Volume volume-aea874ae-94ce-4428-8703-b0771b086323 (aea874ae-94ce-4428-8703-b0771b086323): created successfully Jul 07 21:54:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034beae1-6f1b-491a-8a9f-4c5663f0c80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Flow 'volume_create_manager' (7353066c-f8d7-4d75-a486-4580e226cd0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:54:42 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-e49e0378-6e0e-4df7-a54b-1e42435ca482 req-b3b1fea5-f6c4-40f3-a2d4-40dbf6535192 tempest-VolumesGetTestJSON-1854573434 None] Created volume successfully. Jul 07 21:54:42 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f638976b-e33a-4b9e-9c90-cc3af5dfed91 tempest-DeleteServersTestJSON-1179632775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.738s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:42 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-f638976b-e33a-4b9e-9c90-cc3af5dfed91 tempest-DeleteServersTestJSON-1179632775 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:54:42 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-f638976b-e33a-4b9e-9c90-cc3af5dfed91 tempest-DeleteServersTestJSON-1179632775 None] Deleted volume successfully. Jul 07 21:54:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f638976b-e33a-4b9e-9c90-cc3af5dfed91 tempest-DeleteServersTestJSON-1179632775 None] Lock "cinder-7269f678-df5a-4716-a758-9090460e7959-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:54:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-8699ae3a-c9b6-4362-ac61-7ec4e42d56fd req-e5cc6b61-eadd-4e89-8ca6-302e88ca3198 tempest-VolumesGetTestJSON-1854573434 None] Acquiring lock "cinder-aea874ae-94ce-4428-8703-b0771b086323-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:54:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-8699ae3a-c9b6-4362-ac61-7ec4e42d56fd req-e5cc6b61-eadd-4e89-8ca6-302e88ca3198 tempest-VolumesGetTestJSON-1854573434 None] Lock "cinder-aea874ae-94ce-4428-8703-b0771b086323-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:54:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-8699ae3a-c9b6-4362-ac61-7ec4e42d56fd req-e5cc6b61-eadd-4e89-8ca6-302e88ca3198 tempest-VolumesGetTestJSON-1854573434 None] Acquiring lock "cinder-quobyte-aea874ae-94ce-4428-8703-b0771b086323" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:54:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-8699ae3a-c9b6-4362-ac61-7ec4e42d56fd req-e5cc6b61-eadd-4e89-8ca6-302e88ca3198 tempest-VolumesGetTestJSON-1854573434 None] Lock "cinder-quobyte-aea874ae-94ce-4428-8703-b0771b086323" acquired by "delete_volume" :: waited 0.025s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:54:42 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6ebe98-dfaf-4746-a8bc-fe66d6453aba]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:54:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-8699ae3a-c9b6-4362-ac61-7ec4e42d56fd req-e5cc6b61-eadd-4e89-8ca6-302e88ca3198 tempest-VolumesGetTestJSON-1854573434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-aea874ae-94ce-4428-8703-b0771b086323 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:43 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-aea874ae-94ce-4428-8703-b0771b086323 Jul 07 21:54:43 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:43 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-8699ae3a-c9b6-4362-ac61-7ec4e42d56fd req-e5cc6b61-eadd-4e89-8ca6-302e88ca3198 tempest-VolumesGetTestJSON-1854573434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-aea874ae-94ce-4428-8703-b0771b086323" returned: 0 in 0.887s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-8699ae3a-c9b6-4362-ac61-7ec4e42d56fd req-e5cc6b61-eadd-4e89-8ca6-302e88ca3198 tempest-VolumesGetTestJSON-1854573434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-aea874ae-94ce-4428-8703-b0771b086323 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:43 devstack sudo[90570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-aea874ae-94ce-4428-8703-b0771b086323 Jul 07 21:54:43 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:44 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-8699ae3a-c9b6-4362-ac61-7ec4e42d56fd req-e5cc6b61-eadd-4e89-8ca6-302e88ca3198 tempest-VolumesGetTestJSON-1854573434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-aea874ae-94ce-4428-8703-b0771b086323" returned: 0 in 0.835s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:44 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-8699ae3a-c9b6-4362-ac61-7ec4e42d56fd req-e5cc6b61-eadd-4e89-8ca6-302e88ca3198 tempest-VolumesGetTestJSON-1854573434 None] Lock "cinder-quobyte-aea874ae-94ce-4428-8703-b0771b086323" released by "delete_volume" :: held 1.813s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:54:44 devstack cinder-volume[87586]: DEBUG cinder.quota [req-8699ae3a-c9b6-4362-ac61-7ec4e42d56fd req-e5cc6b61-eadd-4e89-8ca6-302e88ca3198 tempest-VolumesGetTestJSON-1854573434 None] Created reservations ['afa3c2a4-72e1-420d-9f12-53f751ed5815', '2bd4f1c6-3e4c-48c1-b0e8-3b329db3fc69', '512ab9e1-c9b0-4f01-a09d-54acec751cfa', 'c31c6250-6a89-4da0-afa4-572dfbdc7cef'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:54:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-8699ae3a-c9b6-4362-ac61-7ec4e42d56fd req-e5cc6b61-eadd-4e89-8ca6-302e88ca3198 tempest-VolumesGetTestJSON-1854573434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:54:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-8699ae3a-c9b6-4362-ac61-7ec4e42d56fd req-e5cc6b61-eadd-4e89-8ca6-302e88ca3198 tempest-VolumesGetTestJSON-1854573434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:54:44 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [req-8699ae3a-c9b6-4362-ac61-7ec4e42d56fd req-e5cc6b61-eadd-4e89-8ca6-302e88ca3198 tempest-VolumesGetTestJSON-1854573434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:54:44 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [req-8699ae3a-c9b6-4362-ac61-7ec4e42d56fd req-e5cc6b61-eadd-4e89-8ca6-302e88ca3198 tempest-VolumesGetTestJSON-1854573434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:54:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-8699ae3a-c9b6-4362-ac61-7ec4e42d56fd req-e5cc6b61-eadd-4e89-8ca6-302e88ca3198 tempest-VolumesGetTestJSON-1854573434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:54:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-8699ae3a-c9b6-4362-ac61-7ec4e42d56fd req-e5cc6b61-eadd-4e89-8ca6-302e88ca3198 tempest-VolumesGetTestJSON-1854573434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:44 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:54:45 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:46 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-8699ae3a-c9b6-4362-ac61-7ec4e42d56fd req-e5cc6b61-eadd-4e89-8ca6-302e88ca3198 tempest-VolumesGetTestJSON-1854573434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.068s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:46 devstack cinder-volume[87586]: DEBUG cinder.manager [req-8699ae3a-c9b6-4362-ac61-7ec4e42d56fd req-e5cc6b61-eadd-4e89-8ca6-302e88ca3198 tempest-VolumesGetTestJSON-1854573434 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:54:46 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-8699ae3a-c9b6-4362-ac61-7ec4e42d56fd req-e5cc6b61-eadd-4e89-8ca6-302e88ca3198 tempest-VolumesGetTestJSON-1854573434 None] Deleted volume successfully. Jul 07 21:54:46 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-8699ae3a-c9b6-4362-ac61-7ec4e42d56fd req-e5cc6b61-eadd-4e89-8ca6-302e88ca3198 tempest-VolumesGetTestJSON-1854573434 None] Lock "cinder-aea874ae-94ce-4428-8703-b0771b086323-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:54:50 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d46f2c4a-c4e2-48e6-a887-baa42bfafa2e tempest-GroupSnapshotsTest-383499367 None] Group tempest-GroupSnapshotsTest-Group-1810747163: creating Jul 07 21:54:50 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d46f2c4a-c4e2-48e6-a887-baa42bfafa2e tempest-GroupSnapshotsTest-383499367 None] Group tempest-GroupSnapshotsTest-Group-1810747163: created successfully Jul 07 21:54:50 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d46f2c4a-c4e2-48e6-a887-baa42bfafa2e tempest-GroupSnapshotsTest-383499367 None] Create group completed successfully. Jul 07 21:54:51 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:54:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Flow 'volume_create_manager' (dd3c1971-a14f-4564-965e-2dd88ee6d139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:54:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bee378-d7c3-4612-9942-b9fe48de77ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2bee378-d7c3-4612-9942-b9fe48de77ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2108902951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6530e09d-6c07-419a-bf8d-1d972e3a3a0f,host='devstack@QuobyteHD#QuobyteHD',id=1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7eddcbb0f23456583c5e610940d81b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:54:52Z,use_quota=True,user_id='b4733023d4c44823aeccbf0470c23c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bef69e3f-903c-4883-ac15-1cfa0d4ca806),volume_type_id=bef69e3f-903c-4883-ac15-1cfa0d4ca806)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0caa5820-aee2-4a98-8c5f-ba59fe109e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0caa5820-aee2-4a98-8c5f-ba59fe109e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a326e1f6-7384-49b6-9821-210a57404f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a326e1f6-7384-49b6-9821-210a57404f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea', 'volume_name': 'volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02306191-df1f-4a36-95d5-9f2cba7dd80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02306191-df1f-4a36-95d5-9f2cba7dd80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8097d444-0c28-4ebf-91ff-854f73b5e738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:52 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Volume 1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea', 'volume_size': 1} Jul 07 21:54:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:54:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:54:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6530e09d-6c07-419a-bf8d-1d972e3a3a0f,created_at=2026-07-07T19:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2108902951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6530e09d-6c07-419a-bf8d-1d972e3a3a0f,host='devstack@QuobyteHD#QuobyteHD',id=1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7eddcbb0f23456583c5e610940d81b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:54:52Z,use_quota=True,user_id='b4733023d4c44823aeccbf0470c23c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bef69e3f-903c-4883-ac15-1cfa0d4ca806),volume_type_id=bef69e3f-903c-4883-ac15-1cfa0d4ca806)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:54:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Creating volume 1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:54:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:54:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:54:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:54:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:54:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:54:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:54:52 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:54:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:52 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea 1073741824 Jul 07 21:54:52 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:52 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea 1073741824" returned: 0 in 0.882s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:52 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea Jul 07 21:54:52 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:53 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea" returned: 0 in 0.722s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:53 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:54:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:54:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8097d444-0c28-4ebf-91ff-854f73b5e738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45623add-8ded-497f-8256-fefba34797eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:54:53 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Volume volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea (1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea): created successfully Jul 07 21:54:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45623add-8ded-497f-8256-fefba34797eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:54:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Flow 'volume_create_manager' (dd3c1971-a14f-4564-965e-2dd88ee6d139) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:54:53 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-da8591d0-afd3-47ae-9b88-b8478a6a8731 tempest-GroupSnapshotsTest-383499367 None] Created volume successfully. Jul 07 21:54:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-793d69bb-2e0c-48a4-99e5-56d2b98a0bcb req-6c6b9a8e-d3be-4eb1-9024-6e04456ebd48 tempest-ServerActionsTestOtherA-1059080414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:54:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-793d69bb-2e0c-48a4-99e5-56d2b98a0bcb req-6c6b9a8e-d3be-4eb1-9024-6e04456ebd48 tempest-ServerActionsTestOtherA-1059080414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:54:53 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79eaa39-0eea-40e8-8e97-688ea54e902d]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:54:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-793d69bb-2e0c-48a4-99e5-56d2b98a0bcb req-6c6b9a8e-d3be-4eb1-9024-6e04456ebd48 tempest-ServerActionsTestOtherA-1059080414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2553286d-cd27-4001-b6f2-0d47d24de889 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:53 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2553286d-cd27-4001-b6f2-0d47d24de889 Jul 07 21:54:53 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:54 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-eb6af4ec-6756-4ca2-9ae0-00d847a894d9 tempest-GroupSnapshotsTest-383499367 None] GroupSnapshot 92be51ef-f261-4b85-a9ff-620d96b26803: creating. Jul 07 21:54:54 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-793d69bb-2e0c-48a4-99e5-56d2b98a0bcb req-6c6b9a8e-d3be-4eb1-9024-6e04456ebd48 tempest-ServerActionsTestOtherA-1059080414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2553286d-cd27-4001-b6f2-0d47d24de889" returned: 0 in 0.898s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-793d69bb-2e0c-48a4-99e5-56d2b98a0bcb req-6c6b9a8e-d3be-4eb1-9024-6e04456ebd48 tempest-ServerActionsTestOtherA-1059080414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.915s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:54:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-eb6af4ec-6756-4ca2-9ae0-00d847a894d9 tempest-GroupSnapshotsTest-383499367 None] Group snapshot 92be51ef-f261-4b85-a9ff-620d96b26803: creating. {{(pid=87586) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4181}} Jul 07 21:54:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-eb6af4ec-6756-4ca2-9ae0-00d847a894d9 tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:54:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-eb6af4ec-6756-4ca2-9ae0-00d847a894d9 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:54:54 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-eb6af4ec-6756-4ca2-9ae0-00d847a894d9 tempest-GroupSnapshotsTest-383499367 None] Creating offline snapshot 92a14b82-7fac-414b-be0c-718118819c6f of volume 1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 21:54:54 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e27786-7135-4df0-86c3-da0ecd8f9b87]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:54:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb6af4ec-6756-4ca2-9ae0-00d847a894d9 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-793d69bb-2e0c-48a4-99e5-56d2b98a0bcb req-6c6b9a8e-d3be-4eb1-9024-6e04456ebd48 tempest-ServerActionsTestOtherA-1059080414 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491', 'name': 'volume-2553286d-cd27-4001-b6f2-0d47d24de889', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '456c67e6-f9f6-4e4f-b87a-2437efe8aa9f', 'enforce_multipath': True} {{(pid=87586) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4930}} Jul 07 21:54:55 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-793d69bb-2e0c-48a4-99e5-56d2b98a0bcb req-6c6b9a8e-d3be-4eb1-9024-6e04456ebd48 tempest-ServerActionsTestOtherA-1059080414 None] attachment_update completed successfully. Jul 07 21:54:55 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea Jul 07 21:54:55 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:55 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb6af4ec-6756-4ca2-9ae0-00d847a894d9 tempest-GroupSnapshotsTest-383499367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea" returned: 0 in 0.889s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb6af4ec-6756-4ca2-9ae0-00d847a894d9 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:55 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f 1G Jul 07 21:54:55 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:56 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb6af4ec-6756-4ca2-9ae0-00d847a894d9 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f 1G" returned: 0 in 0.982s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb6af4ec-6756-4ca2-9ae0-00d847a894d9 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:56 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f Jul 07 21:54:56 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:57 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb6af4ec-6756-4ca2-9ae0-00d847a894d9 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f" returned: 0 in 0.935s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:57 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-eb6af4ec-6756-4ca2-9ae0-00d847a894d9 tempest-GroupSnapshotsTest-383499367 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f is being set with open permissions: ugo+rw: NotImplementedError Jul 07 21:54:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb6af4ec-6756-4ca2-9ae0-00d847a894d9 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:57 devstack sudo[91040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f Jul 07 21:54:57 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:58 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb6af4ec-6756-4ca2-9ae0-00d847a894d9 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f" returned: 0 in 0.966s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb6af4ec-6756-4ca2-9ae0-00d847a894d9 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:58 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.info Jul 07 21:54:58 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:54:59 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Jul 07 21:54:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb6af4ec-6756-4ca2-9ae0-00d847a894d9 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.info" returned: 0 in 0.819s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:54:59 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-eb6af4ec-6756-4ca2-9ae0-00d847a894d9 tempest-GroupSnapshotsTest-383499367 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 21:54:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb6af4ec-6756-4ca2-9ae0-00d847a894d9 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:54:59 devstack sudo[91048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.info Jul 07 21:54:59 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:00 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb6af4ec-6756-4ca2-9ae0-00d847a894d9 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.info" returned: 0 in 0.812s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-eb6af4ec-6756-4ca2-9ae0-00d847a894d9 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.530s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:55:00 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-eb6af4ec-6756-4ca2-9ae0-00d847a894d9 tempest-GroupSnapshotsTest-383499367 None] group_snapshot 92be51ef-f261-4b85-a9ff-620d96b26803: created successfully Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Flow 'volume_create_manager' (7f57b6c1-e380-48e9-9385-7999ec82dc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0349453a-418c-471e-a292-797faf951181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0349453a-418c-471e-a292-797faf951181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1386597609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90f09ca14f64ecda352e60cf18e450f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:55:01Z,use_quota=True,user_id='91df7198100d41d98450574ea2de2ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43cd096d-0905-430b-bf7c-6b0df47d6340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43cd096d-0905-430b-bf7c-6b0df47d6340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3224748-594a-4bdd-a932-c2e0c78976c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3224748-594a-4bdd-a932-c2e0c78976c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912', 'volume_name': 'volume-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e9ad73-db29-4da8-9f48-37b00f5ee87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e9ad73-db29-4da8-9f48-37b00f5ee87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be4b798-bc45-48ba-9fa7-1f8099981e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:00 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Volume a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912', 'volume_size': 1} Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1386597609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90f09ca14f64ecda352e60cf18e450f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:55:01Z,use_quota=True,user_id='91df7198100d41d98450574ea2de2ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Creating volume a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:55:00 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:55:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:00 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912 1073741824 Jul 07 21:55:00 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:01 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912 1073741824" returned: 0 in 1.023s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:01 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912 Jul 07 21:55:01 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:02 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912" returned: 0 in 0.778s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:55:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:55:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be4b798-bc45-48ba-9fa7-1f8099981e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b090284-3d4b-4235-9137-7cc01fd2bfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:02 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Volume volume-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912 (a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912): created successfully Jul 07 21:55:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b090284-3d4b-4235-9137-7cc01fd2bfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Flow 'volume_create_manager' (7f57b6c1-e380-48e9-9385-7999ec82dc70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:55:02 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6d26ba72-9b8e-4fbd-8dc0-7a54de0fa023 tempest-AttachVolumeTestJSON-1149741386 None] Created volume successfully. Jul 07 21:55:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:55:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:55:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "cinder-quobyte-92a14b82-7fac-414b-be0c-718118819c6f-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da" by "_create_volume_from_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:55:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-92a14b82-7fac-414b-be0c-718118819c6f-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:55:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Creating volume 6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da from snapshot 92a14b82-7fac-414b-be0c-718118819c6f {{(pid=87586) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 21:55:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:55:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:55:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:55:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:55:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:55:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:55:03 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "cinder-quobyte-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da" by "_copy_volume_from_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:55:03 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:55:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] snapshot: 92a14b82-7fac-414b-be0c-718118819c6f, volume: 6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da, {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 21:55:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:55:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:55:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:55:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:55:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:55:03 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-c44a5d48-5f06-4d17-adf5-f84c049ec563 req-c0aa95d3-50ff-41a5-87c7-f65b9571a989 tempest-ServerActionsTestOtherA-1059080414 None] Terminate volume connection completed successfully. Jul 07 21:55:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-c44a5d48-5f06-4d17-adf5-f84c049ec563 req-c0aa95d3-50ff-41a5-87c7-f65b9571a989 tempest-ServerActionsTestOtherA-1059080414 None] Deleting attachment 456c67e6-f9f6-4e4f-b87a-2437efe8aa9f. {{(pid=87586) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 07 21:55:03 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce148379-4d3a-4b83-93f1-1e79ba84586b]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:55:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:03 devstack sudo[91446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f Jul 07 21:55:03 devstack sudo[91446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:03 devstack sudo[91446]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f" returned: 0 in 0.815s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 21:55:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 21:55:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Creating direct copy from snapshot {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 21:55:03 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2df9e29-afab-4b59-9e5e-121635b7b23f]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:55:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:04 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea Jul 07 21:55:04 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:05 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea" returned: 0 in 1.068s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:05 devstack cinder-volume[87586]: DEBUG cinder.utils [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Path /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da not found in is_blk_device check {{(pid=87586) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 21:55:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:05 devstack sudo[91480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da Jul 07 21:55:05 devstack sudo[91480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-c44a5d48-5f06-4d17-adf5-f84c049ec563 req-25be4232-c34b-4dab-bf6a-ce0bc96a67fb tempest-ServerActionsTestOtherA-1059080414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:55:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-27011806-894d-4696-9265-9c4a84eaf9e7 req-93b1ab17-746e-4b28-a9d6-308ae9727400 tempest-AttachVolumeTestJSON-1149741386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:55:11 devstack sudo[91480]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da" returned: 0 in 6.521s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:11 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a72e61-d82d-4940-b237-87bd9e528ac4]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:55:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:11 devstack sudo[91558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea Jul 07 21:55:11 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:12 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea" returned: 0 in 1.039s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:12 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Image conversion details: src /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea, size 1024.00 MB, duration 6.52 sec, destination /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 21:55:12 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Converted 1024.00 MB image at 157.01 MB/s Jul 07 21:55:12 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da is being set with open permissions: ugo+rw: NotImplementedError Jul 07 21:55:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:12 devstack sudo[91570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da Jul 07 21:55:12 devstack sudo[91570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:13 devstack sudo[91570]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da" returned: 0 in 0.668s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da" released by "_copy_volume_from_snapshot" :: held 10.235s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:55:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-92a14b82-7fac-414b-be0c-718118819c6f-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da" released by "_create_volume_from_snapshot" :: held 10.299s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:55:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.346s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:55:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-c44a5d48-5f06-4d17-adf5-f84c049ec563 req-25be4232-c34b-4dab-bf6a-ce0bc96a67fb tempest-ServerActionsTestOtherA-1059080414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.783s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:55:13 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c766306-5441-49e7-a9dd-a526577667ba]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:55:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-c44a5d48-5f06-4d17-adf5-f84c049ec563 req-25be4232-c34b-4dab-bf6a-ce0bc96a67fb tempest-ServerActionsTestOtherA-1059080414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2553286d-cd27-4001-b6f2-0d47d24de889 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:13 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-5afcceaa-cc00-4de5-b8aa-c2348966e85d tempest-GroupSnapshotsTest-383499367 None] Create group from source-snapshot-92be51ef-f261-4b85-a9ff-620d96b26803 completed successfully. Jul 07 21:55:13 devstack sudo[91574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2553286d-cd27-4001-b6f2-0d47d24de889 Jul 07 21:55:13 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:14 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-c44a5d48-5f06-4d17-adf5-f84c049ec563 req-25be4232-c34b-4dab-bf6a-ce0bc96a67fb tempest-ServerActionsTestOtherA-1059080414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2553286d-cd27-4001-b6f2-0d47d24de889" returned: 0 in 0.842s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-c44a5d48-5f06-4d17-adf5-f84c049ec563 req-25be4232-c34b-4dab-bf6a-ce0bc96a67fb tempest-ServerActionsTestOtherA-1059080414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.862s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:55:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-27011806-894d-4696-9265-9c4a84eaf9e7 req-93b1ab17-746e-4b28-a9d6-308ae9727400 tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.414s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:55:14 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a6d429-1bf2-4b3b-93bb-2dfadb35ecc9]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:55:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-27011806-894d-4696-9265-9c4a84eaf9e7 req-93b1ab17-746e-4b28-a9d6-308ae9727400 tempest-AttachVolumeTestJSON-1149741386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-c44a5d48-5f06-4d17-adf5-f84c049ec563 req-25be4232-c34b-4dab-bf6a-ce0bc96a67fb tempest-ServerActionsTestOtherA-1059080414 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491', 'name': 'volume-2553286d-cd27-4001-b6f2-0d47d24de889', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ad72ade-ea27-4494-ac8c-490a52ff4c9d', 'enforce_multipath': True} {{(pid=87586) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4930}} Jul 07 21:55:14 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-c44a5d48-5f06-4d17-adf5-f84c049ec563 req-25be4232-c34b-4dab-bf6a-ce0bc96a67fb tempest-ServerActionsTestOtherA-1059080414 None] attachment_update completed successfully. Jul 07 21:55:14 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912 Jul 07 21:55:14 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:15 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-27011806-894d-4696-9265-9c4a84eaf9e7 req-93b1ab17-746e-4b28-a9d6-308ae9727400 tempest-AttachVolumeTestJSON-1149741386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912" returned: 0 in 0.823s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-27011806-894d-4696-9265-9c4a84eaf9e7 req-93b1ab17-746e-4b28-a9d6-308ae9727400 tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.852s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:55:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-27011806-894d-4696-9265-9c4a84eaf9e7 req-93b1ab17-746e-4b28-a9d6-308ae9727400 tempest-AttachVolumeTestJSON-1149741386 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491', 'name': 'volume-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '503bd698-4a95-4bce-943c-4fa4643f868f', 'enforce_multipath': True} {{(pid=87586) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4930}} Jul 07 21:55:15 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-27011806-894d-4696-9265-9c4a84eaf9e7 req-93b1ab17-746e-4b28-a9d6-308ae9727400 tempest-AttachVolumeTestJSON-1149741386 None] attachment_update completed successfully. Jul 07 21:55:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-69e9ffb3-0a59-4edd-8601-dcf6f2c73d49 tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "cinder-quobyte-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:55:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-69e9ffb3-0a59-4edd-8601-dcf6f2c73d49 tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da" acquired by "delete_volume" :: waited 0.060s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:55:15 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c6e3c4-f1df-4441-8fc0-568929038cd6]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:55:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69e9ffb3-0a59-4edd-8601-dcf6f2c73d49 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:16 devstack sudo[91775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da Jul 07 21:55:16 devstack sudo[91775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:17 devstack sudo[91775]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69e9ffb3-0a59-4edd-8601-dcf6f2c73d49 tempest-GroupSnapshotsTest-383499367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da" returned: 0 in 1.482s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69e9ffb3-0a59-4edd-8601-dcf6f2c73d49 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:17 devstack sudo[92158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da Jul 07 21:55:17 devstack sudo[92158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:18 devstack sudo[92158]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69e9ffb3-0a59-4edd-8601-dcf6f2c73d49 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da" returned: 0 in 0.914s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-69e9ffb3-0a59-4edd-8601-dcf6f2c73d49 tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-6aa3ed1c-f45f-41dd-9e17-e1fc4bc802da" released by "delete_volume" :: held 2.527s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:55:18 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-69e9ffb3-0a59-4edd-8601-dcf6f2c73d49 tempest-GroupSnapshotsTest-383499367 None] Created reservations ['95fab040-16a7-4dcd-8b57-dd630b00ed0e'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:55:18 devstack cinder-volume[87586]: WARNING cinder.quota [None req-69e9ffb3-0a59-4edd-8601-dcf6f2c73d49 tempest-GroupSnapshotsTest-383499367 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-464968214 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-464968214, it is now deprecated. Please use the default quota class for default quota. Jul 07 21:55:18 devstack cinder-volume[87586]: WARNING cinder.quota [None req-69e9ffb3-0a59-4edd-8601-dcf6f2c73d49 tempest-GroupSnapshotsTest-383499367 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-464968214 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-464968214, it is now deprecated. Please use the default quota class for default quota. Jul 07 21:55:18 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-69e9ffb3-0a59-4edd-8601-dcf6f2c73d49 tempest-GroupSnapshotsTest-383499367 None] Created reservations ['d29d7694-5901-4cba-b31a-e2da7e16512e', 'dc3f4691-f828-44ca-826b-8899da835376', '8b7b2163-1b33-44c1-b314-9763e58507ae', 'a408e39c-cff6-4b0c-8d65-823cce12aea7'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:55:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-69e9ffb3-0a59-4edd-8601-dcf6f2c73d49 tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:55:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-69e9ffb3-0a59-4edd-8601-dcf6f2c73d49 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:55:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-69e9ffb3-0a59-4edd-8601-dcf6f2c73d49 tempest-GroupSnapshotsTest-383499367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:55:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-69e9ffb3-0a59-4edd-8601-dcf6f2c73d49 tempest-GroupSnapshotsTest-383499367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:55:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-69e9ffb3-0a59-4edd-8601-dcf6f2c73d49 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:55:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69e9ffb3-0a59-4edd-8601-dcf6f2c73d49 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:19 devstack sudo[92202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:55:19 devstack sudo[92202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:20 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6f917435-f0ff-4c48-bbec-430182b9af6e tempest-GroupSnapshotsTest-383499367 None] group_snapshot 92be51ef-f261-4b85-a9ff-620d96b26803: deleting Jul 07 21:55:20 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6f917435-f0ff-4c48-bbec-430182b9af6e tempest-GroupSnapshotsTest-383499367 None] group_snapshot 92be51ef-f261-4b85-a9ff-620d96b26803: deleting {{(pid=87586) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4356}} Jul 07 21:55:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6f917435-f0ff-4c48-bbec-430182b9af6e tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "cinder-quobyte-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:55:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6f917435-f0ff-4c48-bbec-430182b9af6e tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:55:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6f917435-f0ff-4c48-bbec-430182b9af6e tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "cinder-quobyte-92a14b82-7fac-414b-be0c-718118819c6f" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:55:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6f917435-f0ff-4c48-bbec-430182b9af6e tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-92a14b82-7fac-414b-be0c-718118819c6f" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:55:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-6f917435-f0ff-4c48-bbec-430182b9af6e tempest-GroupSnapshotsTest-383499367 None] Deleting offline snapshot 92a14b82-7fac-414b-be0c-718118819c6f of volume 1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 21:55:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-6f917435-f0ff-4c48-bbec-430182b9af6e tempest-GroupSnapshotsTest-383499367 None] snapshot_file for this snap is: volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 21:55:20 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[888dda64-9f79-4110-b26e-b1ac5de4dfc4]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:55:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f917435-f0ff-4c48-bbec-430182b9af6e tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:20 devstack sudo[92202]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:20 devstack sudo[92222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f Jul 07 21:55:20 devstack sudo[92222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69e9ffb3-0a59-4edd-8601-dcf6f2c73d49 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.890s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:20 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-69e9ffb3-0a59-4edd-8601-dcf6f2c73d49 tempest-GroupSnapshotsTest-383499367 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:55:20 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-69e9ffb3-0a59-4edd-8601-dcf6f2c73d49 tempest-GroupSnapshotsTest-383499367 None] Delete group completed successfully. Jul 07 21:55:22 devstack sudo[92222]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f917435-f0ff-4c48-bbec-430182b9af6e tempest-GroupSnapshotsTest-383499367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f" returned: 0 in 2.093s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-6f917435-f0ff-4c48-bbec-430182b9af6e tempest-GroupSnapshotsTest-383499367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 21:55:22 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9fb3f4-c1da-4c30-9185-cb56fb2e1fb4]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:55:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f917435-f0ff-4c48-bbec-430182b9af6e tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:23 devstack sudo[92250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea Jul 07 21:55:23 devstack sudo[92250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:24 devstack sudo[92250]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f917435-f0ff-4c48-bbec-430182b9af6e tempest-GroupSnapshotsTest-383499367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea" returned: 0 in 1.672s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f917435-f0ff-4c48-bbec-430182b9af6e tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:24 devstack sudo[92263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f Jul 07 21:55:24 devstack sudo[92263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:26 devstack sudo[92263]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f917435-f0ff-4c48-bbec-430182b9af6e tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f" returned: 0 in 2.269s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f917435-f0ff-4c48-bbec-430182b9af6e tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:26 devstack sudo[92304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f Jul 07 21:55:26 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:27 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f917435-f0ff-4c48-bbec-430182b9af6e tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea.92a14b82-7fac-414b-be0c-718118819c6f" returned: 0 in 1.358s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6f917435-f0ff-4c48-bbec-430182b9af6e tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-92a14b82-7fac-414b-be0c-718118819c6f" released by "_delete_snapshot" :: held 7.647s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:55:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6f917435-f0ff-4c48-bbec-430182b9af6e tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea" released by "delete_snapshot" :: held 7.714s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:55:28 devstack cinder-volume[87586]: WARNING cinder.quota [None req-6f917435-f0ff-4c48-bbec-430182b9af6e tempest-GroupSnapshotsTest-383499367 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-464968214 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-464968214, it is now deprecated. Please use the default quota class for default quota. Jul 07 21:55:28 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-6f917435-f0ff-4c48-bbec-430182b9af6e tempest-GroupSnapshotsTest-383499367 None] Created reservations ['438bf2e5-b1a5-4925-ace0-bc9c77ad66a3', '3204b716-3bdc-45f0-82bf-f32ebff19e50', '4bc5bab9-2c66-4d5c-b3ec-7856b94229cd', '887b6f8c-825d-41a8-a937-85166ce9d76c'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:55:28 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6f917435-f0ff-4c48-bbec-430182b9af6e tempest-GroupSnapshotsTest-383499367 None] group_snapshot 92be51ef-f261-4b85-a9ff-620d96b26803: deleted successfully Jul 07 21:55:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8295ee17-69aa-45a2-8ac6-1d76cd58be66 tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "cinder-quobyte-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:55:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8295ee17-69aa-45a2-8ac6-1d76cd58be66 tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea" acquired by "delete_volume" :: waited 0.021s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:55:29 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba879541-a194-42d5-b3cf-162420f841d8]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:55:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8295ee17-69aa-45a2-8ac6-1d76cd58be66 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:29 devstack sudo[92355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea Jul 07 21:55:29 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:30 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8295ee17-69aa-45a2-8ac6-1d76cd58be66 tempest-GroupSnapshotsTest-383499367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea" returned: 0 in 1.252s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8295ee17-69aa-45a2-8ac6-1d76cd58be66 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:30 devstack sudo[92360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea Jul 07 21:55:30 devstack sudo[92360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:31 devstack sudo[92360]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8295ee17-69aa-45a2-8ac6-1d76cd58be66 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea" returned: 0 in 0.797s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8295ee17-69aa-45a2-8ac6-1d76cd58be66 tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-1ba3f0cf-0cb6-4f95-9f56-1170898cd7ea" released by "delete_volume" :: held 2.140s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:55:31 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-8295ee17-69aa-45a2-8ac6-1d76cd58be66 tempest-GroupSnapshotsTest-383499367 None] Created reservations ['8e077aad-97e9-4bc5-88a9-de90086fffcd'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:55:31 devstack cinder-volume[87586]: WARNING cinder.db.api [None req-8295ee17-69aa-45a2-8ac6-1d76cd58be66 tempest-GroupSnapshotsTest-383499367 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-464968214'] Jul 07 21:55:31 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-8295ee17-69aa-45a2-8ac6-1d76cd58be66 tempest-GroupSnapshotsTest-383499367 None] Created reservations ['aa6f950f-93c6-4b9f-b050-85b0fa3a7637', '69a14311-9c3d-411b-8527-bc168ae21fdf', 'b8d9aaac-f90a-4ba5-b212-74508da9ec0d', '3736dd88-d3c9-4885-b80d-cd17d449671e'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:55:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8295ee17-69aa-45a2-8ac6-1d76cd58be66 tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:55:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8295ee17-69aa-45a2-8ac6-1d76cd58be66 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:55:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8295ee17-69aa-45a2-8ac6-1d76cd58be66 tempest-GroupSnapshotsTest-383499367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:55:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8295ee17-69aa-45a2-8ac6-1d76cd58be66 tempest-GroupSnapshotsTest-383499367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:55:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8295ee17-69aa-45a2-8ac6-1d76cd58be66 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:55:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8295ee17-69aa-45a2-8ac6-1d76cd58be66 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:31 devstack sudo[92367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:55:31 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:32 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8295ee17-69aa-45a2-8ac6-1d76cd58be66 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.900s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:32 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-8295ee17-69aa-45a2-8ac6-1d76cd58be66 tempest-GroupSnapshotsTest-383499367 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:55:32 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-8295ee17-69aa-45a2-8ac6-1d76cd58be66 tempest-GroupSnapshotsTest-383499367 None] Delete group completed successfully. Jul 07 21:55:32 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-e81b03e3-f6bf-4b16-8aeb-9eca1fdfe7b2 tempest-GroupSnapshotsTest-383499367 None] Group tempest-GroupSnapshotsTest-Group-1673414205: creating Jul 07 21:55:32 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-e81b03e3-f6bf-4b16-8aeb-9eca1fdfe7b2 tempest-GroupSnapshotsTest-383499367 None] Group tempest-GroupSnapshotsTest-Group-1673414205: created successfully Jul 07 21:55:32 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-e81b03e3-f6bf-4b16-8aeb-9eca1fdfe7b2 tempest-GroupSnapshotsTest-383499367 None] Create group completed successfully. Jul 07 21:55:34 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=68,cinder:INSERT=12,cinder:UPDATE=61,cinder:DELETE=5 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:UPDATE=65,cinder:SELECT=77,cinder:INSERT=14 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Flow 'volume_create_manager' (3dcac7b8-78c3-40c1-bb9e-00d29d7dce99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa213723-33f1-4eb3-aa59-f988651ad133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa213723-33f1-4eb3-aa59-f988651ad133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-537436674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3351de0f-b619-441a-87a0-eef97bd3d855,host='devstack@QuobyteHD#QuobyteHD',id=ecd7b6a2-4965-468c-9e14-f03999fb7ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7eddcbb0f23456583c5e610940d81b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:55:35Z,use_quota=True,user_id='b4733023d4c44823aeccbf0470c23c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99ca3ce1-75ab-4dea-8174-5a793d2465b1),volume_type_id=99ca3ce1-75ab-4dea-8174-5a793d2465b1)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf99f61-5f02-4087-8537-33b5204db181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf99f61-5f02-4087-8537-33b5204db181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1413d4c0-eb58-4c71-a15d-0b167124c19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1413d4c0-eb58-4c71-a15d-0b167124c19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecd7b6a2-4965-468c-9e14-f03999fb7ab0', 'volume_name': 'volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f183db1-dac3-4266-a43a-0cd85624cfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f183db1-dac3-4266-a43a-0cd85624cfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850d8dd1-a531-45ae-8f9f-b5c1a527b518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:35 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Volume ecd7b6a2-4965-468c-9e14-f03999fb7ab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0', 'volume_size': 1} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3351de0f-b619-441a-87a0-eef97bd3d855,created_at=2026-07-07T19:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-537436674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3351de0f-b619-441a-87a0-eef97bd3d855,host='devstack@QuobyteHD#QuobyteHD',id=ecd7b6a2-4965-468c-9e14-f03999fb7ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7eddcbb0f23456583c5e610940d81b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:55:35Z,use_quota=True,user_id='b4733023d4c44823aeccbf0470c23c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99ca3ce1-75ab-4dea-8174-5a793d2465b1),volume_type_id=99ca3ce1-75ab-4dea-8174-5a793d2465b1)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Creating volume ecd7b6a2-4965-468c-9e14-f03999fb7ab0 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:55:35 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:35 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0 1073741824 Jul 07 21:55:35 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:55:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:35 devstack sudo[92449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:55:35 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:37 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 2.411s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:37 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:55:38 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:55:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 8 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 21:55:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 21:55:38 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0 1073741824" returned: 0 in 2.941s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:38 devstack sudo[92551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0 Jul 07 21:55:38 devstack sudo[92551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Flow 'volume_create_manager' (b91f5e86-e3bd-4d0d-bfe9-46a14ac484df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25663595-45d5-4d6e-8c32-6991f6fe873f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:39 devstack sudo[92551]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0" returned: 0 in 1.416s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] <== create_volume: return (4481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.484s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25663595-45d5-4d6e-8c32-6991f6fe873f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-758167011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8db3dd7-df17-4a83-a61e-45159db6b68f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5771d222f040ea9809321110234838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:55:40Z,use_quota=True,user_id='575e30c8300a4db9a0c7c463b3cabe1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cec242c-5802-4831-b62a-f26eb00ad4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cec242c-5802-4831-b62a-f26eb00ad4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c2357f-577c-4dc4-a553-9ac5bd9462c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c2357f-577c-4dc4-a553-9ac5bd9462c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8db3dd7-df17-4a83-a61e-45159db6b68f', 'volume_name': 'volume-c8db3dd7-df17-4a83-a61e-45159db6b68f', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e7f007-d226-4d52-a2b1-c4132baf49cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e7f007-d226-4d52-a2b1-c4132baf49cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f84f971-044b-48cc-b191-21038da7beb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:39 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Volume c8db3dd7-df17-4a83-a61e-45159db6b68f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8db3dd7-df17-4a83-a61e-45159db6b68f', 'volume_size': 1} Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-758167011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8db3dd7-df17-4a83-a61e-45159db6b68f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5771d222f040ea9809321110234838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:55:40Z,use_quota=True,user_id='575e30c8300a4db9a0c7c463b3cabe1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Creating volume c8db3dd7-df17-4a83-a61e-45159db6b68f {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:55:39 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c8db3dd7-df17-4a83-a61e-45159db6b68f 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:39 devstack sudo[92565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c8db3dd7-df17-4a83-a61e-45159db6b68f 1073741824 Jul 07 21:55:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850d8dd1-a531-45ae-8f9f-b5c1a527b518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:39 devstack sudo[92565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b006bfd-04e0-4452-9fd2-6edfe4ffeb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:40 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Volume volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0 (ecd7b6a2-4965-468c-9e14-f03999fb7ab0): created successfully Jul 07 21:55:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b006bfd-04e0-4452-9fd2-6edfe4ffeb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Flow 'volume_create_manager' (3dcac7b8-78c3-40c1-bb9e-00d29d7dce99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:55:40 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-10c597f5-9b06-4658-8516-dcddc4e37501 tempest-GroupSnapshotsTest-383499367 None] Created volume successfully. Jul 07 21:55:41 devstack sudo[92565]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c8db3dd7-df17-4a83-a61e-45159db6b68f 1073741824" returned: 0 in 1.428s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c8db3dd7-df17-4a83-a61e-45159db6b68f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:41 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c8db3dd7-df17-4a83-a61e-45159db6b68f Jul 07 21:55:41 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Flow 'volume_create_manager' (a256ac5f-20fe-4853-bc37-dc19fa47c40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d9e336-d1d2-4630-8ea3-2ddbd9c63ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d9e336-d1d2-4630-8ea3-2ddbd9c63ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-853407307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3351de0f-b619-441a-87a0-eef97bd3d855,host='devstack@QuobyteHD#QuobyteHD',id=5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7eddcbb0f23456583c5e610940d81b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:55:42Z,use_quota=True,user_id='b4733023d4c44823aeccbf0470c23c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99ca3ce1-75ab-4dea-8174-5a793d2465b1),volume_type_id=99ca3ce1-75ab-4dea-8174-5a793d2465b1)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4bdd5d-dd3e-48a3-af95-b82fb98ea48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4bdd5d-dd3e-48a3-af95-b82fb98ea48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d87c33-6421-411d-8ec7-546f5b9b43fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d87c33-6421-411d-8ec7-546f5b9b43fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea', 'volume_name': 'volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78f2941-9987-4143-988f-6aa7dc67eefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78f2941-9987-4143-988f-6aa7dc67eefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14951a98-2c5a-46f4-bf25-c3412edce1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:42 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Volume 5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea', 'volume_size': 1} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:55:42 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c8db3dd7-df17-4a83-a61e-45159db6b68f" returned: 0 in 1.435s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] <== create_volume: return (2965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.967s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.480s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3351de0f-b619-441a-87a0-eef97bd3d855,created_at=2026-07-07T19:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-853407307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3351de0f-b619-441a-87a0-eef97bd3d855,host='devstack@QuobyteHD#QuobyteHD',id=5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7eddcbb0f23456583c5e610940d81b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:55:42Z,use_quota=True,user_id='b4733023d4c44823aeccbf0470c23c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99ca3ce1-75ab-4dea-8174-5a793d2465b1),volume_type_id=99ca3ce1-75ab-4dea-8174-5a793d2465b1)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Creating volume 5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:55:42 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f84f971-044b-48cc-b191-21038da7beb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8db3dd7-df17-4a83-a61e-45159db6b68f', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:42 devstack sudo[92606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea 1073741824 Jul 07 21:55:42 devstack sudo[92606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55078ab1-f933-4007-a44e-6f758644de7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:42 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Volume volume-c8db3dd7-df17-4a83-a61e-45159db6b68f (c8db3dd7-df17-4a83-a61e-45159db6b68f): created successfully Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55078ab1-f933-4007-a44e-6f758644de7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Flow 'volume_create_manager' (b91f5e86-e3bd-4d0d-bfe9-46a14ac484df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:55:43 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-c31dfed2-9fdc-4b2a-91b2-2ccbf7b67f06 tempest-ServerRescueNegativeTestJSON-1729724042 None] Created volume successfully. Jul 07 21:55:44 devstack sudo[92606]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea 1073741824" returned: 0 in 1.315s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:44 devstack sudo[92613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea Jul 07 21:55:44 devstack sudo[92613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:45 devstack sudo[92613]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea" returned: 0 in 0.804s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] <== create_volume: return (2205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:55:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.208s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:55:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14951a98-2c5a-46f4-bf25-c3412edce1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4daa2bf-eb67-4c98-b49f-79244aee1060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:55:45 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Volume volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea (5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea): created successfully Jul 07 21:55:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4daa2bf-eb67-4c98-b49f-79244aee1060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:55:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Flow 'volume_create_manager' (a256ac5f-20fe-4853-bc37-dc19fa47c40f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:55:45 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d13de777-ac39-4903-87eb-7e2c57cc3303 tempest-GroupSnapshotsTest-383499367 None] Created volume successfully. Jul 07 21:55:46 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-17abc5e5-cc08-46f9-b9c6-8b8d65bb7919 tempest-GroupSnapshotsTest-383499367 None] Update group completed successfully. Jul 07 21:55:47 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-3124bdab-dd5b-4e3b-bea1-3780fbf9ad3b tempest-GroupSnapshotsTest-383499367 None] Update group completed successfully. Jul 07 21:55:48 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-9e037f2e-e506-4bb9-96eb-7eaea70e37e1 tempest-GroupSnapshotsTest-383499367 None] Update group completed successfully. Jul 07 21:55:50 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-87290a1a-a8a2-4dd2-ad1b-d3c09f8f514d tempest-GroupSnapshotsTest-383499367 None] Update group completed successfully. Jul 07 21:55:51 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] GroupSnapshot 93764f0b-f828-4dde-8843-8010bef73658: creating. Jul 07 21:55:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] Group snapshot 93764f0b-f828-4dde-8843-8010bef73658: creating. {{(pid=87586) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4181}} Jul 07 21:55:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:55:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:55:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] Creating offline snapshot 3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1 of volume ecd7b6a2-4965-468c-9e14-f03999fb7ab0 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 21:55:51 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[355abf3b-4b11-473b-a972-aaa196a7a25f]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:55:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:51 devstack sudo[92655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0 Jul 07 21:55:51 devstack sudo[92655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:52 devstack sudo[92655]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0" returned: 0 in 0.856s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:52 devstack sudo[92660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1 1G Jul 07 21:55:52 devstack sudo[92660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:53 devstack sudo[92660]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1 1G" returned: 0 in 0.885s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:53 devstack sudo[92690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1 Jul 07 21:55:53 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:54 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1" returned: 0 in 0.741s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:54 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 21:55:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:54 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1 Jul 07 21:55:54 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:55 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1" returned: 0 in 0.770s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:55 devstack sudo[92701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.info Jul 07 21:55:55 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:55 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.info" returned: 0 in 0.770s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:55 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 21:55:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:55 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.info Jul 07 21:55:55 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:56 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.info" returned: 0 in 0.693s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.813s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:55:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:55:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:55:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] Creating offline snapshot bbe37fd4-1226-4826-9523-0693763792ac of volume 5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 21:55:56 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3da89d5-b02b-47c9-a88d-804452e9927e]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:55:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:56 devstack sudo[92708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea Jul 07 21:55:56 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:57 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea" returned: 0 in 1.019s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.bbe37fd4-1226-4826-9523-0693763792ac 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:57 devstack sudo[92713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.bbe37fd4-1226-4826-9523-0693763792ac 1G Jul 07 21:55:57 devstack sudo[92713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:58 devstack sudo[92713]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.bbe37fd4-1226-4826-9523-0693763792ac 1G" returned: 0 in 0.969s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.bbe37fd4-1226-4826-9523-0693763792ac {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:58 devstack sudo[92727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.bbe37fd4-1226-4826-9523-0693763792ac Jul 07 21:55:58 devstack sudo[92727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:55:59 devstack sudo[92727]: pam_unix(sudo:session): session closed for user root Jul 07 21:55:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.bbe37fd4-1226-4826-9523-0693763792ac" returned: 0 in 0.770s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:55:59 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.bbe37fd4-1226-4826-9523-0693763792ac is being set with open permissions: ugo+rw: NotImplementedError Jul 07 21:55:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.bbe37fd4-1226-4826-9523-0693763792ac {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:55:59 devstack sudo[92752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.bbe37fd4-1226-4826-9523-0693763792ac Jul 07 21:55:59 devstack sudo[92752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:00 devstack sudo[92752]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.bbe37fd4-1226-4826-9523-0693763792ac" returned: 0 in 0.701s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:00 devstack sudo[92756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.info Jul 07 21:56:00 devstack sudo[92756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:00 devstack sudo[92756]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.info" returned: 0 in 0.652s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:00 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 21:56:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:00 devstack sudo[92759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.info Jul 07 21:56:00 devstack sudo[92759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:01 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-934325a8-fa88-4feb-8cc6-7ce2e1ebbff2 tempest-ServerRescueNegativeTestJSON-1729724042 None] Acquiring lock "cinder-c8db3dd7-df17-4a83-a61e-45159db6b68f-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:56:01 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-934325a8-fa88-4feb-8cc6-7ce2e1ebbff2 tempest-ServerRescueNegativeTestJSON-1729724042 None] Lock "cinder-c8db3dd7-df17-4a83-a61e-45159db6b68f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:56:01 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-934325a8-fa88-4feb-8cc6-7ce2e1ebbff2 tempest-ServerRescueNegativeTestJSON-1729724042 None] Acquiring lock "cinder-quobyte-c8db3dd7-df17-4a83-a61e-45159db6b68f" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:56:01 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-934325a8-fa88-4feb-8cc6-7ce2e1ebbff2 tempest-ServerRescueNegativeTestJSON-1729724042 None] Lock "cinder-quobyte-c8db3dd7-df17-4a83-a61e-45159db6b68f" acquired by "delete_volume" :: waited 0.039s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:56:01 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bdaa54-a585-4a73-b89f-63c7ea0a6b50]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:56:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-934325a8-fa88-4feb-8cc6-7ce2e1ebbff2 tempest-ServerRescueNegativeTestJSON-1729724042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c8db3dd7-df17-4a83-a61e-45159db6b68f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:01 devstack sudo[92759]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.info" returned: 0 in 0.749s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:01 devstack sudo[92763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c8db3dd7-df17-4a83-a61e-45159db6b68f Jul 07 21:56:01 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.990s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:56:01 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-4befcba4-cb29-4b7f-89c0-a588fb7b2664 tempest-GroupSnapshotsTest-383499367 None] group_snapshot 93764f0b-f828-4dde-8843-8010bef73658: created successfully Jul 07 21:56:02 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-934325a8-fa88-4feb-8cc6-7ce2e1ebbff2 tempest-ServerRescueNegativeTestJSON-1729724042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c8db3dd7-df17-4a83-a61e-45159db6b68f" returned: 0 in 1.206s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-934325a8-fa88-4feb-8cc6-7ce2e1ebbff2 tempest-ServerRescueNegativeTestJSON-1729724042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c8db3dd7-df17-4a83-a61e-45159db6b68f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:02 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c8db3dd7-df17-4a83-a61e-45159db6b68f Jul 07 21:56:02 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:02 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] group_snapshot 93764f0b-f828-4dde-8843-8010bef73658: deleting Jul 07 21:56:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] group_snapshot 93764f0b-f828-4dde-8843-8010bef73658: deleting {{(pid=87586) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4356}} Jul 07 21:56:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "cinder-quobyte-ecd7b6a2-4965-468c-9e14-f03999fb7ab0" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:56:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-ecd7b6a2-4965-468c-9e14-f03999fb7ab0" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:56:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "cinder-quobyte-3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:56:03 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:56:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Deleting offline snapshot 3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1 of volume ecd7b6a2-4965-468c-9e14-f03999fb7ab0 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 21:56:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] snapshot_file for this snap is: volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 21:56:03 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c7b9c4-86be-41e2-b2d1-929d7eb875e8]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:56:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:03 devstack sudo[92775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1 Jul 07 21:56:03 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:03 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-934325a8-fa88-4feb-8cc6-7ce2e1ebbff2 tempest-ServerRescueNegativeTestJSON-1729724042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c8db3dd7-df17-4a83-a61e-45159db6b68f" returned: 0 in 1.267s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:03 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-934325a8-fa88-4feb-8cc6-7ce2e1ebbff2 tempest-ServerRescueNegativeTestJSON-1729724042 None] Lock "cinder-quobyte-c8db3dd7-df17-4a83-a61e-45159db6b68f" released by "delete_volume" :: held 2.541s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:56:03 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-934325a8-fa88-4feb-8cc6-7ce2e1ebbff2 tempest-ServerRescueNegativeTestJSON-1729724042 None] Created reservations ['105ed837-0369-4ae3-968a-342bbb90709e', '62559aa8-246e-42b4-ab0a-8dec0becd8bf', 'db712c61-a221-4370-a7be-55c59a1106cf', '0bd56ee7-6100-471d-a6fb-aa90f49b185b'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:56:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-934325a8-fa88-4feb-8cc6-7ce2e1ebbff2 tempest-ServerRescueNegativeTestJSON-1729724042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:56:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-934325a8-fa88-4feb-8cc6-7ce2e1ebbff2 tempest-ServerRescueNegativeTestJSON-1729724042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:56:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-934325a8-fa88-4feb-8cc6-7ce2e1ebbff2 tempest-ServerRescueNegativeTestJSON-1729724042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:56:04 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-934325a8-fa88-4feb-8cc6-7ce2e1ebbff2 tempest-ServerRescueNegativeTestJSON-1729724042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:56:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-934325a8-fa88-4feb-8cc6-7ce2e1ebbff2 tempest-ServerRescueNegativeTestJSON-1729724042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:56:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-934325a8-fa88-4feb-8cc6-7ce2e1ebbff2 tempest-ServerRescueNegativeTestJSON-1729724042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:04 devstack sudo[92780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:56:04 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:04 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1" returned: 0 in 1.146s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:04 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 21:56:04 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5f90ae-e555-449e-bb5b-b4661eb53732]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:56:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:04 devstack sudo[92785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0 Jul 07 21:56:04 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:04 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-934325a8-fa88-4feb-8cc6-7ce2e1ebbff2 tempest-ServerRescueNegativeTestJSON-1729724042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.860s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:04 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-934325a8-fa88-4feb-8cc6-7ce2e1ebbff2 tempest-ServerRescueNegativeTestJSON-1729724042 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:56:04 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-934325a8-fa88-4feb-8cc6-7ce2e1ebbff2 tempest-ServerRescueNegativeTestJSON-1729724042 None] Deleted volume successfully. Jul 07 21:56:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-934325a8-fa88-4feb-8cc6-7ce2e1ebbff2 tempest-ServerRescueNegativeTestJSON-1729724042 None] Lock "cinder-c8db3dd7-df17-4a83-a61e-45159db6b68f-delete_volume" released by "delete_volume" :: held 3.768s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:56:05 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-871b17f0-c18b-4e8e-a19c-1cec7d5cca1b req-0d1e2654-178b-4ed0-8a03-5ea8b87353d3 tempest-ServerActionsTestOtherA-1059080414 None] Terminate volume connection completed successfully. Jul 07 21:56:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-871b17f0-c18b-4e8e-a19c-1cec7d5cca1b req-0d1e2654-178b-4ed0-8a03-5ea8b87353d3 tempest-ServerActionsTestOtherA-1059080414 None] Deleting attachment 5ad72ade-ea27-4494-ac8c-490a52ff4c9d. {{(pid=87586) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 07 21:56:05 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-9ae2fdf9-3163-40d1-8007-d8c7c1ade89f req-5bd3d288-c269-4dc5-ab2c-760ff1a4dc42 tempest-AttachVolumeTestJSON-1149741386 None] Terminate volume connection completed successfully. Jul 07 21:56:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-9ae2fdf9-3163-40d1-8007-d8c7c1ade89f req-5bd3d288-c269-4dc5-ab2c-760ff1a4dc42 tempest-AttachVolumeTestJSON-1149741386 None] Deleting attachment 503bd698-4a95-4bce-943c-4fa4643f868f. {{(pid=87586) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 07 21:56:05 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0" returned: 0 in 1.104s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:05 devstack sudo[92797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1 Jul 07 21:56:05 devstack sudo[92797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:06 devstack sudo[92797]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1" returned: 0 in 0.934s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:06 devstack sudo[92811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1 Jul 07 21:56:06 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:07 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0.3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1" returned: 0 in 1.141s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-3fcb7d4a-d122-4b9e-b0e1-7ed698c089b1" released by "_delete_snapshot" :: held 4.543s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:56:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-ecd7b6a2-4965-468c-9e14-f03999fb7ab0" released by "delete_snapshot" :: held 4.591s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:56:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "cinder-quobyte-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:56:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:56:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "cinder-quobyte-bbe37fd4-1226-4826-9523-0693763792ac" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:56:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-bbe37fd4-1226-4826-9523-0693763792ac" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:56:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Deleting offline snapshot bbe37fd4-1226-4826-9523-0693763792ac of volume 5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 21:56:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] snapshot_file for this snap is: volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.bbe37fd4-1226-4826-9523-0693763792ac {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 21:56:07 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dee258-c32f-4e95-8616-321494b46818]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:56:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.bbe37fd4-1226-4826-9523-0693763792ac {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:07 devstack sudo[92835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.bbe37fd4-1226-4826-9523-0693763792ac Jul 07 21:56:07 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:08 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.bbe37fd4-1226-4826-9523-0693763792ac" returned: 0 in 1.170s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 21:56:08 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c71fd4e-85d2-47fa-abe6-6041d2cd102c]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:56:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:09 devstack sudo[92851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea Jul 07 21:56:09 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:10 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea" returned: 0 in 1.293s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.bbe37fd4-1226-4826-9523-0693763792ac {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:10 devstack sudo[92876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.bbe37fd4-1226-4826-9523-0693763792ac Jul 07 21:56:10 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:11 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.bbe37fd4-1226-4826-9523-0693763792ac" returned: 0 in 1.000s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.bbe37fd4-1226-4826-9523-0693763792ac {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:11 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.bbe37fd4-1226-4826-9523-0693763792ac Jul 07 21:56:11 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:12 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea.bbe37fd4-1226-4826-9523-0693763792ac" returned: 0 in 0.831s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:12 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-bbe37fd4-1226-4826-9523-0693763792ac" released by "_delete_snapshot" :: held 4.433s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:56:12 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea" released by "delete_snapshot" :: held 4.467s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:56:12 devstack cinder-volume[87586]: WARNING cinder.quota [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2053715369 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2053715369, it is now deprecated. Please use the default quota class for default quota. Jul 07 21:56:12 devstack cinder-volume[87586]: WARNING cinder.quota [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2053715369 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2053715369, it is now deprecated. Please use the default quota class for default quota. Jul 07 21:56:12 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Created reservations ['3fdf2737-8e22-46a7-8918-c8732ffa99b0', 'de4c0702-fb02-455a-8454-a6f272aa41f8', 'fb5dad9e-f5a3-4cb0-8cdb-81cf6f3ba8f6', '6a062fdc-c905-4b98-b79e-e9dbb47f1c18'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:56:12 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] Created reservations ['a09604df-1dce-492e-a54b-9bfd311b4b32', '5fbbba5a-8495-488b-8e4a-5e441eea3e5c', '7950f41c-780c-4af3-94d0-aa2a38d072a3', '654b9dc5-54cc-4b95-9059-faf8d0722d38'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:56:12 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-445595ed-2576-4a0f-845e-b01d5e6fbe0e tempest-GroupSnapshotsTest-383499367 None] group_snapshot 93764f0b-f828-4dde-8843-8010bef73658: deleted successfully Jul 07 21:56:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "cinder-quobyte-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:56:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea" acquired by "delete_volume" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:56:13 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[06585d65-9938-4d4b-b462-e0734334c1f5]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:56:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:13 devstack sudo[92896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea Jul 07 21:56:13 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:14 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea" returned: 0 in 0.764s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:14 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea Jul 07 21:56:14 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:15 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea" returned: 0 in 0.824s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-5bcf77ef-fb66-43f0-92dd-edfffc8bf6ea" released by "delete_volume" :: held 1.672s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:56:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "cinder-quobyte-ecd7b6a2-4965-468c-9e14-f03999fb7ab0" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:56:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-ecd7b6a2-4965-468c-9e14-f03999fb7ab0" acquired by "delete_volume" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:56:15 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f298415e-4b86-4419-bc13-8975dd47e8e7]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:56:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:15 devstack sudo[92927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0 Jul 07 21:56:15 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:16 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0" returned: 0 in 1.122s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:16 devstack sudo[92948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0 Jul 07 21:56:16 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:17 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ecd7b6a2-4965-468c-9e14-f03999fb7ab0" returned: 0 in 0.752s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:17 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-ecd7b6a2-4965-468c-9e14-f03999fb7ab0" released by "delete_volume" :: held 1.937s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:56:17 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] Created reservations ['c5267db4-1a07-42a1-81eb-aac0933db662'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:56:17 devstack cinder-volume[87586]: WARNING cinder.quota [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2053715369 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2053715369, it is now deprecated. Please use the default quota class for default quota. Jul 07 21:56:17 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] Created reservations ['d5813684-c8e3-4efe-a698-9ac0f4a0268b', '3a65f985-d8f7-4fe8-b853-62be97da5da1', 'b6dda6dc-71c0-490b-a968-5d3fd4ccd1c1', '2a237fa4-c28e-4eac-a020-78fe9b35b715'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:56:17 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4cda3e99-b3db-4376-a626-bb8b771f06d9 tempest-ServerActionsTestOtherA-1059080414 None] Acquiring lock "cinder-2553286d-cd27-4001-b6f2-0d47d24de889-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:56:17 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4cda3e99-b3db-4376-a626-bb8b771f06d9 tempest-ServerActionsTestOtherA-1059080414 None] Lock "cinder-2553286d-cd27-4001-b6f2-0d47d24de889-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:56:17 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4cda3e99-b3db-4376-a626-bb8b771f06d9 tempest-ServerActionsTestOtherA-1059080414 None] Acquiring lock "cinder-quobyte-2553286d-cd27-4001-b6f2-0d47d24de889" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:56:17 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4cda3e99-b3db-4376-a626-bb8b771f06d9 tempest-ServerActionsTestOtherA-1059080414 None] Lock "cinder-quobyte-2553286d-cd27-4001-b6f2-0d47d24de889" acquired by "delete_volume" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:56:17 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45ea480-b704-47d0-a044-792b78ebe5b1]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:56:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4cda3e99-b3db-4376-a626-bb8b771f06d9 tempest-ServerActionsTestOtherA-1059080414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2553286d-cd27-4001-b6f2-0d47d24de889 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:17 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] Created reservations ['f634f13c-191f-451b-9bc2-a1021aab090b', 'cf6e0e6f-6c3b-48f6-a1e4-61ee28ef09fc', '38f9f060-f1a7-4030-8a51-ac338b9f35f8', '0282c630-7e06-4252-adc6-0e1759fe9cb0'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:56:17 devstack sudo[92960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2553286d-cd27-4001-b6f2-0d47d24de889 Jul 07 21:56:17 devstack sudo[92960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:56:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:56:17 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:56:17 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:56:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:56:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:17 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:56:17 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:18 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.775s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:18 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:56:18 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-9d12ac24-bf33-4bd6-98cb-5800b618c998 tempest-GroupSnapshotsTest-383499367 None] Delete group completed successfully. Jul 07 21:56:18 devstack sudo[92960]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4cda3e99-b3db-4376-a626-bb8b771f06d9 tempest-ServerActionsTestOtherA-1059080414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2553286d-cd27-4001-b6f2-0d47d24de889" returned: 0 in 1.011s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4cda3e99-b3db-4376-a626-bb8b771f06d9 tempest-ServerActionsTestOtherA-1059080414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2553286d-cd27-4001-b6f2-0d47d24de889 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:18 devstack sudo[92996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2553286d-cd27-4001-b6f2-0d47d24de889 Jul 07 21:56:18 devstack sudo[92996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:19 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-10a1481a-c17f-46a6-8ed0-c975e3e977f3 tempest-GroupSnapshotsTest-383499367 None] Group tempest-GroupSnapshotsTest-Group-1483881601: creating Jul 07 21:56:19 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-10a1481a-c17f-46a6-8ed0-c975e3e977f3 tempest-GroupSnapshotsTest-383499367 None] Group tempest-GroupSnapshotsTest-Group-1483881601: created successfully Jul 07 21:56:19 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-10a1481a-c17f-46a6-8ed0-c975e3e977f3 tempest-GroupSnapshotsTest-383499367 None] Create group completed successfully. Jul 07 21:56:19 devstack sudo[92996]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4cda3e99-b3db-4376-a626-bb8b771f06d9 tempest-ServerActionsTestOtherA-1059080414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2553286d-cd27-4001-b6f2-0d47d24de889" returned: 0 in 1.360s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4cda3e99-b3db-4376-a626-bb8b771f06d9 tempest-ServerActionsTestOtherA-1059080414 None] Lock "cinder-quobyte-2553286d-cd27-4001-b6f2-0d47d24de889" released by "delete_volume" :: held 2.427s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:56:20 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-4cda3e99-b3db-4376-a626-bb8b771f06d9 tempest-ServerActionsTestOtherA-1059080414 None] Created reservations ['b740195b-2325-4565-9b47-1403f70c3644', '9c23ed6b-5b3f-4e61-8da1-9f6ee3508e8f', '1faeb08f-2b1d-4d79-884a-c43859ef7f80', '0e92dcd6-b825-4564-b465-45235533771c'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:56:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4cda3e99-b3db-4376-a626-bb8b771f06d9 tempest-ServerActionsTestOtherA-1059080414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:56:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4cda3e99-b3db-4376-a626-bb8b771f06d9 tempest-ServerActionsTestOtherA-1059080414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:56:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4cda3e99-b3db-4376-a626-bb8b771f06d9 tempest-ServerActionsTestOtherA-1059080414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:56:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4cda3e99-b3db-4376-a626-bb8b771f06d9 tempest-ServerActionsTestOtherA-1059080414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:56:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4cda3e99-b3db-4376-a626-bb8b771f06d9 tempest-ServerActionsTestOtherA-1059080414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:56:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4cda3e99-b3db-4376-a626-bb8b771f06d9 tempest-ServerActionsTestOtherA-1059080414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:20 devstack sudo[93052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:56:20 devstack sudo[93052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:20 devstack sudo[93052]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4cda3e99-b3db-4376-a626-bb8b771f06d9 tempest-ServerActionsTestOtherA-1059080414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.806s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:20 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-4cda3e99-b3db-4376-a626-bb8b771f06d9 tempest-ServerActionsTestOtherA-1059080414 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:56:20 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-4cda3e99-b3db-4376-a626-bb8b771f06d9 tempest-ServerActionsTestOtherA-1059080414 None] Deleted volume successfully. Jul 07 21:56:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4cda3e99-b3db-4376-a626-bb8b771f06d9 tempest-ServerActionsTestOtherA-1059080414 None] Lock "cinder-2553286d-cd27-4001-b6f2-0d47d24de889-delete_volume" released by "delete_volume" :: held 3.475s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:56:21 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:56:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Flow 'volume_create_manager' (136192c7-2233-46d8-9a60-332368f10c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:56:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e77439-fd24-478d-9871-29beb589be40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:56:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e77439-fd24-478d-9871-29beb589be40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1987416400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb4db711-8d32-427f-892f-85b18b321921,host='devstack@QuobyteHD#QuobyteHD',id=651a5487-f8e4-4055-9a13-b5895b701f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7eddcbb0f23456583c5e610940d81b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:56:22Z,use_quota=True,user_id='b4733023d4c44823aeccbf0470c23c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a883920d-22b9-4b2d-90c6-f617e1df5931),volume_type_id=a883920d-22b9-4b2d-90c6-f617e1df5931)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:56:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fff9d92-22a7-495e-a8f5-d1b5537b41eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:56:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fff9d92-22a7-495e-a8f5-d1b5537b41eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:56:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c90750d-ded2-4392-94f0-d3c5b8c03f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:56:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c90750d-ded2-4392-94f0-d3c5b8c03f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '651a5487-f8e4-4055-9a13-b5895b701f40', 'volume_name': 'volume-651a5487-f8e4-4055-9a13-b5895b701f40', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:56:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9673ba-7ab6-41bb-882a-05513f0d4f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:56:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9673ba-7ab6-41bb-882a-05513f0d4f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:56:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1779b1-af57-4476-9356-deada788e1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:56:21 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Volume 651a5487-f8e4-4055-9a13-b5895b701f40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-651a5487-f8e4-4055-9a13-b5895b701f40', 'volume_size': 1} Jul 07 21:56:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:56:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:56:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fb4db711-8d32-427f-892f-85b18b321921,created_at=2026-07-07T19:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1987416400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb4db711-8d32-427f-892f-85b18b321921,host='devstack@QuobyteHD#QuobyteHD',id=651a5487-f8e4-4055-9a13-b5895b701f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7eddcbb0f23456583c5e610940d81b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:56:22Z,use_quota=True,user_id='b4733023d4c44823aeccbf0470c23c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a883920d-22b9-4b2d-90c6-f617e1df5931),volume_type_id=a883920d-22b9-4b2d-90c6-f617e1df5931)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:56:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Creating volume 651a5487-f8e4-4055-9a13-b5895b701f40 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:56:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:56:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:56:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:56:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:56:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:56:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:56:21 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:56:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:21 devstack sudo[93072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40 1073741824 Jul 07 21:56:21 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:23 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40 1073741824" returned: 0 in 1.558s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:23 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40 Jul 07 21:56:23 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:24 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40" returned: 0 in 1.014s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] <== create_volume: return (2666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:56:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.676s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:56:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1779b1-af57-4476-9356-deada788e1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-651a5487-f8e4-4055-9a13-b5895b701f40', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:56:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f5d82e-e90f-41e3-b162-1f6fe3611e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:56:24 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Volume volume-651a5487-f8e4-4055-9a13-b5895b701f40 (651a5487-f8e4-4055-9a13-b5895b701f40): created successfully Jul 07 21:56:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f5d82e-e90f-41e3-b162-1f6fe3611e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:56:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Flow 'volume_create_manager' (136192c7-2233-46d8-9a60-332368f10c2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:56:24 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-cd5e47cb-a841-4380-8ba8-ead8b7a5288b tempest-GroupSnapshotsTest-383499367 None] Created volume successfully. Jul 07 21:56:26 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6f8a84d5-350f-4bd8-929e-a817519e3074 tempest-GroupSnapshotsTest-383499367 None] GroupSnapshot d55cb34f-c802-48a4-b42d-ff6135df2a33: creating. Jul 07 21:56:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6f8a84d5-350f-4bd8-929e-a817519e3074 tempest-GroupSnapshotsTest-383499367 None] Group snapshot d55cb34f-c802-48a4-b42d-ff6135df2a33: creating. {{(pid=87586) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4181}} Jul 07 21:56:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6f8a84d5-350f-4bd8-929e-a817519e3074 tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:56:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6f8a84d5-350f-4bd8-929e-a817519e3074 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:56:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-6f8a84d5-350f-4bd8-929e-a817519e3074 tempest-GroupSnapshotsTest-383499367 None] Creating offline snapshot 47286747-c1d5-45ef-be20-082c17311492 of volume 651a5487-f8e4-4055-9a13-b5895b701f40 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 21:56:26 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[230f5b8b-cdca-464b-a16d-797fa311d67e]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:56:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f8a84d5-350f-4bd8-929e-a817519e3074 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:26 devstack sudo[93107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40 Jul 07 21:56:26 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:27 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f8a84d5-350f-4bd8-929e-a817519e3074 tempest-GroupSnapshotsTest-383499367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40" returned: 0 in 1.184s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f8a84d5-350f-4bd8-929e-a817519e3074 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.47286747-c1d5-45ef-be20-082c17311492 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:27 devstack sudo[93114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.47286747-c1d5-45ef-be20-082c17311492 1G Jul 07 21:56:27 devstack sudo[93114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:28 devstack sudo[93114]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f8a84d5-350f-4bd8-929e-a817519e3074 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.47286747-c1d5-45ef-be20-082c17311492 1G" returned: 0 in 1.188s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f8a84d5-350f-4bd8-929e-a817519e3074 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-651a5487-f8e4-4055-9a13-b5895b701f40 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.47286747-c1d5-45ef-be20-082c17311492 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:28 devstack sudo[93156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-651a5487-f8e4-4055-9a13-b5895b701f40 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.47286747-c1d5-45ef-be20-082c17311492 Jul 07 21:56:28 devstack sudo[93156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:29 devstack sudo[93156]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f8a84d5-350f-4bd8-929e-a817519e3074 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-651a5487-f8e4-4055-9a13-b5895b701f40 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.47286747-c1d5-45ef-be20-082c17311492" returned: 0 in 0.910s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:29 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-6f8a84d5-350f-4bd8-929e-a817519e3074 tempest-GroupSnapshotsTest-383499367 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.47286747-c1d5-45ef-be20-082c17311492 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 21:56:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f8a84d5-350f-4bd8-929e-a817519e3074 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.47286747-c1d5-45ef-be20-082c17311492 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:29 devstack sudo[93161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.47286747-c1d5-45ef-be20-082c17311492 Jul 07 21:56:29 devstack sudo[93161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:30 devstack sudo[93161]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f8a84d5-350f-4bd8-929e-a817519e3074 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.47286747-c1d5-45ef-be20-082c17311492" returned: 0 in 1.029s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f8a84d5-350f-4bd8-929e-a817519e3074 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:30 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.info Jul 07 21:56:30 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:31 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f8a84d5-350f-4bd8-929e-a817519e3074 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.info" returned: 0 in 1.033s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:31 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-6f8a84d5-350f-4bd8-929e-a817519e3074 tempest-GroupSnapshotsTest-383499367 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 21:56:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f8a84d5-350f-4bd8-929e-a817519e3074 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:31 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.info Jul 07 21:56:31 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:32 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f8a84d5-350f-4bd8-929e-a817519e3074 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.info" returned: 0 in 0.908s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6f8a84d5-350f-4bd8-929e-a817519e3074 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.388s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:56:32 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6f8a84d5-350f-4bd8-929e-a817519e3074 tempest-GroupSnapshotsTest-383499367 None] group_snapshot d55cb34f-c802-48a4-b42d-ff6135df2a33: created successfully Jul 07 21:56:34 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] group_snapshot d55cb34f-c802-48a4-b42d-ff6135df2a33: deleting Jul 07 21:56:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] group_snapshot d55cb34f-c802-48a4-b42d-ff6135df2a33: deleting {{(pid=87586) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4356}} Jul 07 21:56:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "cinder-quobyte-651a5487-f8e4-4055-9a13-b5895b701f40" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:56:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-651a5487-f8e4-4055-9a13-b5895b701f40" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:56:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "cinder-quobyte-47286747-c1d5-45ef-be20-082c17311492" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:56:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-47286747-c1d5-45ef-be20-082c17311492" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:56:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] Deleting offline snapshot 47286747-c1d5-45ef-be20-082c17311492 of volume 651a5487-f8e4-4055-9a13-b5895b701f40 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 21:56:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] snapshot_file for this snap is: volume-651a5487-f8e4-4055-9a13-b5895b701f40.47286747-c1d5-45ef-be20-082c17311492 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 21:56:34 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e426d6-df45-4637-96ab-69bbd5bd0130]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:56:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.47286747-c1d5-45ef-be20-082c17311492 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:34 devstack sudo[93181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.47286747-c1d5-45ef-be20-082c17311492 Jul 07 21:56:34 devstack sudo[93181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:35 devstack sudo[93181]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.47286747-c1d5-45ef-be20-082c17311492" returned: 0 in 0.973s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-651a5487-f8e4-4055-9a13-b5895b701f40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 21:56:35 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00a3dca-7db1-4eca-810d-80bdea2a28d1]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:56:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:35 devstack sudo[93187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40 Jul 07 21:56:35 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:56:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:56:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:56:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:56:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:56:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:56:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:35 devstack sudo[93189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:56:35 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:36 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40" returned: 0 in 0.890s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.47286747-c1d5-45ef-be20-082c17311492 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:36 devstack sudo[93195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.47286747-c1d5-45ef-be20-082c17311492 Jul 07 21:56:36 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:36 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.772s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:56:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:56:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 8 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 21:56:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 21:56:37 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.47286747-c1d5-45ef-be20-082c17311492" returned: 0 in 1.002s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.47286747-c1d5-45ef-be20-082c17311492 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:37 devstack sudo[93203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.47286747-c1d5-45ef-be20-082c17311492 Jul 07 21:56:37 devstack sudo[93203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:38 devstack sudo[93203]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40.47286747-c1d5-45ef-be20-082c17311492" returned: 0 in 0.842s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:38 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-47286747-c1d5-45ef-be20-082c17311492" released by "_delete_snapshot" :: held 3.871s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:56:38 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-651a5487-f8e4-4055-9a13-b5895b701f40" released by "delete_snapshot" :: held 3.907s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:56:38 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:UPDATE=77,cinder:INSERT=18,cinder:SELECT=64,cinder:DELETE=1 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:56:38 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=76,cinder:UPDATE=62,cinder:DELETE=5,cinder:INSERT=14 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:56:38 devstack cinder-volume[87586]: WARNING cinder.quota [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1945754010 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1945754010, it is now deprecated. Please use the default quota class for default quota. Jul 07 21:56:38 devstack cinder-volume[87586]: WARNING cinder.quota [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1945754010 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1945754010, it is now deprecated. Please use the default quota class for default quota. Jul 07 21:56:38 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] Created reservations ['b15e977d-4d9b-4848-984b-4bfd171f46f8', '4bfe1f28-1dd9-49a5-884f-ed19c6b988ca', 'f6461be8-f3ab-42a3-9367-e49f8c348c55', '3fbcd64d-c983-46e8-86b9-24f5bd7716c5'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:56:38 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-8c9b92a3-f68f-4936-aaf3-5f0cd6ce988a tempest-GroupSnapshotsTest-383499367 None] group_snapshot d55cb34f-c802-48a4-b42d-ff6135df2a33: deleted successfully Jul 07 21:56:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-87906243-19b2-4aec-ad84-eb6f78fa0dd1 tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "cinder-quobyte-651a5487-f8e4-4055-9a13-b5895b701f40" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:56:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-87906243-19b2-4aec-ad84-eb6f78fa0dd1 tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-651a5487-f8e4-4055-9a13-b5895b701f40" acquired by "delete_volume" :: waited 0.037s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:56:39 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[66338a15-aaf2-471b-a32e-270aaae5264b]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:56:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-87906243-19b2-4aec-ad84-eb6f78fa0dd1 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:39 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40 Jul 07 21:56:39 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:40 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-87906243-19b2-4aec-ad84-eb6f78fa0dd1 tempest-GroupSnapshotsTest-383499367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40" returned: 0 in 0.964s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-87906243-19b2-4aec-ad84-eb6f78fa0dd1 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:40 devstack sudo[93211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40 Jul 07 21:56:40 devstack sudo[93211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:40 devstack sudo[93211]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-87906243-19b2-4aec-ad84-eb6f78fa0dd1 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-651a5487-f8e4-4055-9a13-b5895b701f40" returned: 0 in 0.793s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-87906243-19b2-4aec-ad84-eb6f78fa0dd1 tempest-GroupSnapshotsTest-383499367 None] Lock "cinder-quobyte-651a5487-f8e4-4055-9a13-b5895b701f40" released by "delete_volume" :: held 1.871s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:56:41 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-87906243-19b2-4aec-ad84-eb6f78fa0dd1 tempest-GroupSnapshotsTest-383499367 None] Created reservations ['f8578954-f868-40e2-8734-1a5b3a972c6f'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:56:41 devstack cinder-volume[87586]: WARNING cinder.quota [None req-87906243-19b2-4aec-ad84-eb6f78fa0dd1 tempest-GroupSnapshotsTest-383499367 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1945754010 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1945754010, it is now deprecated. Please use the default quota class for default quota. Jul 07 21:56:41 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-87906243-19b2-4aec-ad84-eb6f78fa0dd1 tempest-GroupSnapshotsTest-383499367 None] Created reservations ['6c0acf7f-ef19-4fe4-a86b-73dc32130487', '9f886378-48b4-4e48-a006-9e9d0c53a7cb', 'c0573ba9-5b6d-4af8-99c0-cb1ba166e2b7', 'c4e2c55c-cdb7-4618-9a8c-b15586204829'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:56:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-87906243-19b2-4aec-ad84-eb6f78fa0dd1 tempest-GroupSnapshotsTest-383499367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:56:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-87906243-19b2-4aec-ad84-eb6f78fa0dd1 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:56:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-87906243-19b2-4aec-ad84-eb6f78fa0dd1 tempest-GroupSnapshotsTest-383499367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:56:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-87906243-19b2-4aec-ad84-eb6f78fa0dd1 tempest-GroupSnapshotsTest-383499367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:56:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-87906243-19b2-4aec-ad84-eb6f78fa0dd1 tempest-GroupSnapshotsTest-383499367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:56:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-87906243-19b2-4aec-ad84-eb6f78fa0dd1 tempest-GroupSnapshotsTest-383499367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:56:41 devstack sudo[93214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:56:41 devstack sudo[93214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:56:42 devstack sudo[93214]: pam_unix(sudo:session): session closed for user root Jul 07 21:56:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-87906243-19b2-4aec-ad84-eb6f78fa0dd1 tempest-GroupSnapshotsTest-383499367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.807s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:56:42 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-87906243-19b2-4aec-ad84-eb6f78fa0dd1 tempest-GroupSnapshotsTest-383499367 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:56:42 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-87906243-19b2-4aec-ad84-eb6f78fa0dd1 tempest-GroupSnapshotsTest-383499367 None] Delete group completed successfully. Jul 07 21:56:51 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=9,cinder:INSERT=6,cinder:UPDATE=18 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:56:51 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=17,cinder:INSERT=3,cinder:UPDATE=15 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:56:57 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-5a352951-b103-4f34-92e5-2d95a102cf10 tempest-GroupsTest-154998916 None] Group tempest-Group1-60923769: creating Jul 07 21:56:57 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-5a352951-b103-4f34-92e5-2d95a102cf10 tempest-GroupsTest-154998916 None] Group tempest-Group1-60923769: created successfully Jul 07 21:56:57 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-5a352951-b103-4f34-92e5-2d95a102cf10 tempest-GroupsTest-154998916 None] Create group completed successfully. Jul 07 21:56:58 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-572f93d7-dac6-4bb3-869f-6cbacbd5ba7d tempest-GroupsTest-154998916 None] Group tempest-Group2-1407266544: creating Jul 07 21:56:58 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-572f93d7-dac6-4bb3-869f-6cbacbd5ba7d tempest-GroupsTest-154998916 None] Group tempest-Group2-1407266544: created successfully Jul 07 21:56:58 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-572f93d7-dac6-4bb3-869f-6cbacbd5ba7d tempest-GroupsTest-154998916 None] Create group completed successfully. Jul 07 21:57:00 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:57:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Flow 'volume_create_manager' (479740d6-e9b2-411a-8f38-0b12c973efd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:57:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b25bf67-bac0-4ce3-ba48-a552ce425209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b25bf67-bac0-4ce3-ba48-a552ce425209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-305102602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9544ef6b-db22-44d4-bd43-5640e1af958b,host='devstack@QuobyteHD#QuobyteHD',id=9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831cb3b670e34c8b9d484ce6f750880b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:57:00Z,use_quota=True,user_id='4c1a51e5d3ab44cdaed83c2d71c99914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62a4dfc5-74d6-4727-a8e3-08b6e4030fef),volume_type_id=62a4dfc5-74d6-4727-a8e3-08b6e4030fef)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4596e055-89b4-4652-a65c-92b3e5e25727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4596e055-89b4-4652-a65c-92b3e5e25727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3373fd-517f-4631-905c-f9a843712ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3373fd-517f-4631-905c-f9a843712ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3', 'volume_name': 'volume-9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b85acba-b6d5-4307-9899-9d3782228c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b85acba-b6d5-4307-9899-9d3782228c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426d2a25-0568-414c-9275-0f35de3da987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:00 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Volume 9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3', 'volume_size': 1} Jul 07 21:57:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9544ef6b-db22-44d4-bd43-5640e1af958b,created_at=2026-07-07T19:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-305102602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9544ef6b-db22-44d4-bd43-5640e1af958b,host='devstack@QuobyteHD#QuobyteHD',id=9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831cb3b670e34c8b9d484ce6f750880b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:57:00Z,use_quota=True,user_id='4c1a51e5d3ab44cdaed83c2d71c99914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62a4dfc5-74d6-4727-a8e3-08b6e4030fef),volume_type_id=62a4dfc5-74d6-4727-a8e3-08b6e4030fef)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:57:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Creating volume 9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:57:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:57:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:57:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:57:00 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:57:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:00 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3 1073741824 Jul 07 21:57:00 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:01 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3 1073741824" returned: 0 in 1.048s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:01 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3 Jul 07 21:57:01 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:02 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3" returned: 0 in 0.838s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:57:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426d2a25-0568-414c-9275-0f35de3da987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (508b36cd-066f-46fa-afa9-f02c309f13f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:02 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Volume volume-9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3 (9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3): created successfully Jul 07 21:57:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (508b36cd-066f-46fa-afa9-f02c309f13f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Flow 'volume_create_manager' (479740d6-e9b2-411a-8f38-0b12c973efd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:57:02 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ca6e99af-a55e-4030-8543-7681d75fd787 tempest-GroupsTest-154998916 None] Created volume successfully. Jul 07 21:57:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-dcdb53d6-f717-490d-b1c9-0b852537b874 tempest-GroupsTest-154998916 None] Acquiring lock "cinder-quobyte-9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:57:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-dcdb53d6-f717-490d-b1c9-0b852537b874 tempest-GroupsTest-154998916 None] Lock "cinder-quobyte-9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3" acquired by "delete_volume" :: waited 0.029s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:57:04 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bad5ea2-53b6-4abf-a2d7-d2c051f04ded]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:57:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dcdb53d6-f717-490d-b1c9-0b852537b874 tempest-GroupsTest-154998916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:04 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3 Jul 07 21:57:04 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:06 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dcdb53d6-f717-490d-b1c9-0b852537b874 tempest-GroupsTest-154998916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3" returned: 0 in 1.497s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dcdb53d6-f717-490d-b1c9-0b852537b874 tempest-GroupsTest-154998916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:06 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3 Jul 07 21:57:06 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:07 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dcdb53d6-f717-490d-b1c9-0b852537b874 tempest-GroupsTest-154998916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3" returned: 0 in 0.988s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-dcdb53d6-f717-490d-b1c9-0b852537b874 tempest-GroupsTest-154998916 None] Lock "cinder-quobyte-9c6a7753-5356-4f7e-aae7-dd9eb81bf4c3" released by "delete_volume" :: held 2.598s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:57:07 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-dcdb53d6-f717-490d-b1c9-0b852537b874 tempest-GroupsTest-154998916 None] Created reservations ['928d015a-8567-43e0-a407-0cb7d2179006'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:57:07 devstack cinder-volume[87586]: WARNING cinder.quota [None req-dcdb53d6-f717-490d-b1c9-0b852537b874 tempest-GroupsTest-154998916 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-688933142 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-688933142, it is now deprecated. Please use the default quota class for default quota. Jul 07 21:57:07 devstack cinder-volume[87586]: WARNING cinder.quota [None req-dcdb53d6-f717-490d-b1c9-0b852537b874 tempest-GroupsTest-154998916 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-688933142 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-688933142, it is now deprecated. Please use the default quota class for default quota. Jul 07 21:57:07 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-dcdb53d6-f717-490d-b1c9-0b852537b874 tempest-GroupsTest-154998916 None] Created reservations ['c393132d-eb9c-415b-ac3f-9e276e45ec09', '558542f1-f9e7-4fa5-9c0d-de3f3f59f002', 'dece0b5d-80a3-47ee-9133-24370f2d2c8a', 'effa627c-3e91-4ad5-9a44-b06859db0f9d'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:57:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dcdb53d6-f717-490d-b1c9-0b852537b874 tempest-GroupsTest-154998916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dcdb53d6-f717-490d-b1c9-0b852537b874 tempest-GroupsTest-154998916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dcdb53d6-f717-490d-b1c9-0b852537b874 tempest-GroupsTest-154998916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:57:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dcdb53d6-f717-490d-b1c9-0b852537b874 tempest-GroupsTest-154998916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:57:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dcdb53d6-f717-490d-b1c9-0b852537b874 tempest-GroupsTest-154998916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dcdb53d6-f717-490d-b1c9-0b852537b874 tempest-GroupsTest-154998916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:07 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:57:07 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:08 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dcdb53d6-f717-490d-b1c9-0b852537b874 tempest-GroupsTest-154998916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.029s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:08 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-dcdb53d6-f717-490d-b1c9-0b852537b874 tempest-GroupsTest-154998916 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:57:08 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-dcdb53d6-f717-490d-b1c9-0b852537b874 tempest-GroupsTest-154998916 None] Delete group completed successfully. Jul 07 21:57:08 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-62b0cfc2-4631-4411-8cd9-fa555312c080 tempest-GroupsTest-154998916 None] Created reservations ['e9e2023a-423e-4843-bc9d-498bae739bc1'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:57:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-62b0cfc2-4631-4411-8cd9-fa555312c080 tempest-GroupsTest-154998916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-62b0cfc2-4631-4411-8cd9-fa555312c080 tempest-GroupsTest-154998916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-62b0cfc2-4631-4411-8cd9-fa555312c080 tempest-GroupsTest-154998916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:57:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-62b0cfc2-4631-4411-8cd9-fa555312c080 tempest-GroupsTest-154998916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:57:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-62b0cfc2-4631-4411-8cd9-fa555312c080 tempest-GroupsTest-154998916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-62b0cfc2-4631-4411-8cd9-fa555312c080 tempest-GroupsTest-154998916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:08 devstack sudo[93407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:57:08 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:09 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-62b0cfc2-4631-4411-8cd9-fa555312c080 tempest-GroupsTest-154998916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.997s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:09 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-62b0cfc2-4631-4411-8cd9-fa555312c080 tempest-GroupsTest-154998916 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:57:09 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-62b0cfc2-4631-4411-8cd9-fa555312c080 tempest-GroupsTest-154998916 None] Delete group completed successfully. Jul 07 21:57:10 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-3ea29389-83a9-4a29-addf-e33ce51dbd47 tempest-GroupsTest-154998916 None] Group tempest-GroupsTest-Group-2123582127: creating Jul 07 21:57:10 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-3ea29389-83a9-4a29-addf-e33ce51dbd47 tempest-GroupsTest-154998916 None] Group tempest-GroupsTest-Group-2123582127: created successfully Jul 07 21:57:10 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-3ea29389-83a9-4a29-addf-e33ce51dbd47 tempest-GroupsTest-154998916 None] Create group completed successfully. Jul 07 21:57:12 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:57:12 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Flow 'volume_create_manager' (f4f8e7ed-f23d-44d5-b3cb-4232685fc7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:57:12 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b64b3f6-89ad-4d26-8d59-ea0766794d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b64b3f6-89ad-4d26-8d59-ea0766794d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1698587470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e0fec9a3-e7cc-4033-811d-eb3dd67f6da7,host='devstack@QuobyteHD#QuobyteHD',id=4f8f6c64-7574-407b-b6d7-8ee8a91a042b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831cb3b670e34c8b9d484ce6f750880b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:57:13Z,use_quota=True,user_id='4c1a51e5d3ab44cdaed83c2d71c99914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(564e8a06-47fc-4117-a70d-042aa57b66c5),volume_type_id=564e8a06-47fc-4117-a70d-042aa57b66c5)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8228f848-33e5-444a-a382-786fb9c653c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8228f848-33e5-444a-a382-786fb9c653c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c37f6e44-ea9a-4ccc-8ab8-301bbfdf804c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c37f6e44-ea9a-4ccc-8ab8-301bbfdf804c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f8f6c64-7574-407b-b6d7-8ee8a91a042b', 'volume_name': 'volume-4f8f6c64-7574-407b-b6d7-8ee8a91a042b', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938b4c3c-7dd0-4907-a3d3-06a2de1aed86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (938b4c3c-7dd0-4907-a3d3-06a2de1aed86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc03c8c5-1fb7-4929-a070-e05d4f0413c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:13 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Volume 4f8f6c64-7574-407b-b6d7-8ee8a91a042b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f8f6c64-7574-407b-b6d7-8ee8a91a042b', 'volume_size': 1} Jul 07 21:57:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e0fec9a3-e7cc-4033-811d-eb3dd67f6da7,created_at=2026-07-07T19:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1698587470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e0fec9a3-e7cc-4033-811d-eb3dd67f6da7,host='devstack@QuobyteHD#QuobyteHD',id=4f8f6c64-7574-407b-b6d7-8ee8a91a042b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831cb3b670e34c8b9d484ce6f750880b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:57:13Z,use_quota=True,user_id='4c1a51e5d3ab44cdaed83c2d71c99914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(564e8a06-47fc-4117-a70d-042aa57b66c5),volume_type_id=564e8a06-47fc-4117-a70d-042aa57b66c5)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:57:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Creating volume 4f8f6c64-7574-407b-b6d7-8ee8a91a042b {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:57:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:57:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:57:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:57:13 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:57:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f8f6c64-7574-407b-b6d7-8ee8a91a042b 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:13 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f8f6c64-7574-407b-b6d7-8ee8a91a042b 1073741824 Jul 07 21:57:13 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:14 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f8f6c64-7574-407b-b6d7-8ee8a91a042b 1073741824" returned: 0 in 1.423s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f8f6c64-7574-407b-b6d7-8ee8a91a042b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:14 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f8f6c64-7574-407b-b6d7-8ee8a91a042b Jul 07 21:57:14 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:16 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f8f6c64-7574-407b-b6d7-8ee8a91a042b" returned: 0 in 1.483s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] <== create_volume: return (3002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:57:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.004s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc03c8c5-1fb7-4929-a070-e05d4f0413c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f8f6c64-7574-407b-b6d7-8ee8a91a042b', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcfb5ea9-0abe-47ca-865f-4828a986b675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:16 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Volume volume-4f8f6c64-7574-407b-b6d7-8ee8a91a042b (4f8f6c64-7574-407b-b6d7-8ee8a91a042b): created successfully Jul 07 21:57:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcfb5ea9-0abe-47ca-865f-4828a986b675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Flow 'volume_create_manager' (f4f8e7ed-f23d-44d5-b3cb-4232685fc7eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:57:16 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-48461903-c71c-4ea4-b3ce-7ab22b19686f tempest-GroupsTest-154998916 None] Created volume successfully. Jul 07 21:57:18 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:57:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Flow 'volume_create_manager' (9e33c58c-be80-4b36-b73e-81e1d9fdf495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:57:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d03dc591-121e-4800-89e5-066a0e5fa2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d03dc591-121e-4800-89e5-066a0e5fa2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-191199720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e0fec9a3-e7cc-4033-811d-eb3dd67f6da7,host='devstack@QuobyteHD#QuobyteHD',id=c9dfce4f-31e4-47dc-bd24-94a64bf304f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831cb3b670e34c8b9d484ce6f750880b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:57:18Z,use_quota=True,user_id='4c1a51e5d3ab44cdaed83c2d71c99914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(564e8a06-47fc-4117-a70d-042aa57b66c5),volume_type_id=564e8a06-47fc-4117-a70d-042aa57b66c5)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4589ad0-73a3-4ab3-a6f6-0029583eaf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4589ad0-73a3-4ab3-a6f6-0029583eaf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d9f205-7fea-4836-8d14-e0d174fcbb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d9f205-7fea-4836-8d14-e0d174fcbb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9dfce4f-31e4-47dc-bd24-94a64bf304f9', 'volume_name': 'volume-c9dfce4f-31e4-47dc-bd24-94a64bf304f9', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8bd71a-ff41-4a42-b784-e11a59c292be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8bd71a-ff41-4a42-b784-e11a59c292be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e134699-b797-4a65-ae5a-1264ccbcdae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:18 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Volume c9dfce4f-31e4-47dc-bd24-94a64bf304f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9dfce4f-31e4-47dc-bd24-94a64bf304f9', 'volume_size': 1} Jul 07 21:57:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e0fec9a3-e7cc-4033-811d-eb3dd67f6da7,created_at=2026-07-07T19:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-191199720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e0fec9a3-e7cc-4033-811d-eb3dd67f6da7,host='devstack@QuobyteHD#QuobyteHD',id=c9dfce4f-31e4-47dc-bd24-94a64bf304f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831cb3b670e34c8b9d484ce6f750880b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:57:18Z,use_quota=True,user_id='4c1a51e5d3ab44cdaed83c2d71c99914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(564e8a06-47fc-4117-a70d-042aa57b66c5),volume_type_id=564e8a06-47fc-4117-a70d-042aa57b66c5)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:57:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Creating volume c9dfce4f-31e4-47dc-bd24-94a64bf304f9 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:57:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:57:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:57:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:57:18 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:57:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9dfce4f-31e4-47dc-bd24-94a64bf304f9 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:18 devstack sudo[93572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9dfce4f-31e4-47dc-bd24-94a64bf304f9 1073741824 Jul 07 21:57:18 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:20 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9dfce4f-31e4-47dc-bd24-94a64bf304f9 1073741824" returned: 0 in 1.504s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9dfce4f-31e4-47dc-bd24-94a64bf304f9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:20 devstack sudo[93583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9dfce4f-31e4-47dc-bd24-94a64bf304f9 Jul 07 21:57:20 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:21 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9dfce4f-31e4-47dc-bd24-94a64bf304f9" returned: 0 in 1.090s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] <== create_volume: return (2648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:57:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.653s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e134699-b797-4a65-ae5a-1264ccbcdae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9dfce4f-31e4-47dc-bd24-94a64bf304f9', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ce05f7-5c5b-452d-a38c-dc43d9557f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:21 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Volume volume-c9dfce4f-31e4-47dc-bd24-94a64bf304f9 (c9dfce4f-31e4-47dc-bd24-94a64bf304f9): created successfully Jul 07 21:57:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ce05f7-5c5b-452d-a38c-dc43d9557f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Flow 'volume_create_manager' (9e33c58c-be80-4b36-b73e-81e1d9fdf495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:57:21 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-15efb1a8-f47e-4afc-8063-0d2d9ab8d07f tempest-GroupsTest-154998916 None] Created volume successfully. Jul 07 21:57:22 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-f97749f0-d911-4fa9-92de-df929f55417d tempest-GroupsTest-154998916 None] Update group completed successfully. Jul 07 21:57:24 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-27fbd6d2-e7d7-42ff-b606-d6e65ef4f512 tempest-GroupsTest-154998916 None] Update group completed successfully. Jul 07 21:57:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Acquiring lock "cinder-quobyte-4f8f6c64-7574-407b-b6d7-8ee8a91a042b" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:57:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Lock "cinder-quobyte-4f8f6c64-7574-407b-b6d7-8ee8a91a042b" acquired by "delete_volume" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:57:25 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[11af163b-9550-4660-b679-eaae6dfd5c29]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:57:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f8f6c64-7574-407b-b6d7-8ee8a91a042b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:25 devstack sudo[93611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f8f6c64-7574-407b-b6d7-8ee8a91a042b Jul 07 21:57:25 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:26 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f8f6c64-7574-407b-b6d7-8ee8a91a042b" returned: 0 in 0.772s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f8f6c64-7574-407b-b6d7-8ee8a91a042b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:26 devstack sudo[93616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f8f6c64-7574-407b-b6d7-8ee8a91a042b Jul 07 21:57:26 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:27 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f8f6c64-7574-407b-b6d7-8ee8a91a042b" returned: 0 in 0.664s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Lock "cinder-quobyte-4f8f6c64-7574-407b-b6d7-8ee8a91a042b" released by "delete_volume" :: held 1.485s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:57:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Acquiring lock "cinder-quobyte-c9dfce4f-31e4-47dc-bd24-94a64bf304f9" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:57:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Lock "cinder-quobyte-c9dfce4f-31e4-47dc-bd24-94a64bf304f9" acquired by "delete_volume" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:57:27 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[440d89a1-bfc2-4d0e-8bd1-2183116dd14d]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:57:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9dfce4f-31e4-47dc-bd24-94a64bf304f9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:27 devstack sudo[93619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9dfce4f-31e4-47dc-bd24-94a64bf304f9 Jul 07 21:57:27 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:28 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9dfce4f-31e4-47dc-bd24-94a64bf304f9" returned: 0 in 0.765s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9dfce4f-31e4-47dc-bd24-94a64bf304f9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:28 devstack sudo[93626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9dfce4f-31e4-47dc-bd24-94a64bf304f9 Jul 07 21:57:28 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:28 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9dfce4f-31e4-47dc-bd24-94a64bf304f9" returned: 0 in 0.661s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Lock "cinder-quobyte-c9dfce4f-31e4-47dc-bd24-94a64bf304f9" released by "delete_volume" :: held 1.464s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:57:28 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Created reservations ['ba941742-1f78-4877-90fb-201d0d900631'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:57:28 devstack cinder-volume[87586]: WARNING cinder.quota [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-90791539 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-90791539, it is now deprecated. Please use the default quota class for default quota. Jul 07 21:57:28 devstack cinder-volume[87586]: WARNING cinder.quota [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-90791539 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-90791539, it is now deprecated. Please use the default quota class for default quota. Jul 07 21:57:28 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Created reservations ['98069933-8ade-437d-a8a9-d35fdac2b4d1', '5377c923-b2ac-4a21-9762-6dcbd0d6e3be', 'be228d30-b8c8-4596-bdd7-503dda32689d', 'ea6555f0-8de3-4cb9-b6c8-edf2547dc39f'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:57:29 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Created reservations ['17ddcc0e-79b5-4dc4-a793-1b3ee8d050dd', 'c737b7ff-8265-4dd2-b490-001e03c835e2', 'fd6e6750-ac44-4b57-9115-a80aaa0c6c2d', '5a667e21-390d-4260-b644-e4ab9609d827'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:57:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:29 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:57:29 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:57:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:29 devstack sudo[93689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:57:29 devstack sudo[93689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:29 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:57:29 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Flow 'volume_create_manager' (694a1322-d983-42db-8158-e02d619910b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:57:29 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625e2824-5ccd-4468-b1f0-d96e3280c8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625e2824-5ccd-4468-b1f0-d96e3280c8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1960460254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bba6fd7-3076-4286-b07b-922917007c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6560a0009744577bafab8f2ac720be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:57:30Z,use_quota=True,user_id='37d70e2e7bdb4ad59dd95d95757c86d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e2e361-4b18-4b02-a48e-61e615350d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e2e361-4b18-4b02-a48e-61e615350d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a425e88-5327-4855-9690-16a8cc716574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:30 devstack sudo[93689]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a425e88-5327-4855-9690-16a8cc716574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bba6fd7-3076-4286-b07b-922917007c47', 'volume_name': 'volume-8bba6fd7-3076-4286-b07b-922917007c47', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a43f49-f62c-476d-8f49-572f9cf0a325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a43f49-f62c-476d-8f49-572f9cf0a325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a5d5d66-cc77-4e8f-92cb-46085b29b7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:30 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Volume 8bba6fd7-3076-4286-b07b-922917007c47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bba6fd7-3076-4286-b07b-922917007c47', 'volume_size': 1} Jul 07 21:57:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1960460254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bba6fd7-3076-4286-b07b-922917007c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6560a0009744577bafab8f2ac720be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:57:30Z,use_quota=True,user_id='37d70e2e7bdb4ad59dd95d95757c86d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:57:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Creating volume 8bba6fd7-3076-4286-b07b-922917007c47 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:57:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:57:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:57:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:57:30 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:57:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bba6fd7-3076-4286-b07b-922917007c47 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.917s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:30 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:57:30 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-8ae20876-4c5f-4532-9d2d-9a1d799407c9 tempest-GroupsTest-154998916 None] Delete group completed successfully. Jul 07 21:57:30 devstack sudo[93709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bba6fd7-3076-4286-b07b-922917007c47 1073741824 Jul 07 21:57:30 devstack sudo[93709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:31 devstack sudo[93709]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bba6fd7-3076-4286-b07b-922917007c47 1073741824" returned: 0 in 0.936s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bba6fd7-3076-4286-b07b-922917007c47 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:31 devstack sudo[93721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bba6fd7-3076-4286-b07b-922917007c47 Jul 07 21:57:31 devstack sudo[93721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:31 devstack sudo[93721]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bba6fd7-3076-4286-b07b-922917007c47" returned: 0 in 0.687s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:57:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a5d5d66-cc77-4e8f-92cb-46085b29b7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bba6fd7-3076-4286-b07b-922917007c47', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42cb07f3-58b8-4cdc-ad4d-cef192ff8b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:31 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Volume volume-8bba6fd7-3076-4286-b07b-922917007c47 (8bba6fd7-3076-4286-b07b-922917007c47): created successfully Jul 07 21:57:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42cb07f3-58b8-4cdc-ad4d-cef192ff8b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Flow 'volume_create_manager' (694a1322-d983-42db-8158-e02d619910b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:57:31 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-af1c7351-b6bc-43b8-8031-51887562fcba tempest-AttachVolumeShelveTestJSON-1131525885 None] Created volume successfully. Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Flow 'volume_create_manager' (a2d50f2d-654f-4a5c-b78a-510eac92acbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7447ed65-6bed-4acf-a3e3-bbc1881e4e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7447ed65-6bed-4acf-a3e3-bbc1881e4e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1556140030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ba9e7a8-baf6-4501-8571-c108b1ca37aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d522225dee049239eca970bc52a7e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:57:35Z,use_quota=True,user_id='763dfc9e4530404587697c4d50a665aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f010a2fd-fde7-4716-bdd0-746ce09512cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f010a2fd-fde7-4716-bdd0-746ce09512cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314384de-ef0c-4124-b67d-acd98f335f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314384de-ef0c-4124-b67d-acd98f335f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ba9e7a8-baf6-4501-8571-c108b1ca37aa', 'volume_name': 'volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf69553-d4ba-4c94-919c-a33c02b6fc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf69553-d4ba-4c94-919c-a33c02b6fc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d855e008-8e60-47a1-98ec-f8ebf5ab8dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:35 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Volume 7ba9e7a8-baf6-4501-8571-c108b1ca37aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa', 'volume_size': 1} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1556140030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ba9e7a8-baf6-4501-8571-c108b1ca37aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d522225dee049239eca970bc52a7e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:57:35Z,use_quota=True,user_id='763dfc9e4530404587697c4d50a665aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Creating volume 7ba9e7a8-baf6-4501-8571-c108b1ca37aa {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:57:35 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:35 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa 1073741824 Jul 07 21:57:35 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:35 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:57:35 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:36 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa 1073741824" returned: 0 in 0.975s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:36 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa Jul 07 21:57:36 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:36 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.761s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:57:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:57:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 8 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 21:57:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 21:57:36 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" returned: 0 in 0.660s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:36 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:57:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d855e008-8e60-47a1-98ec-f8ebf5ab8dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ab47b0-38a1-4ed9-8f60-0b86a62ed358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:36 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Volume volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa (7ba9e7a8-baf6-4501-8571-c108b1ca37aa): created successfully Jul 07 21:57:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ab47b0-38a1-4ed9-8f60-0b86a62ed358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Flow 'volume_create_manager' (a2d50f2d-654f-4a5c-b78a-510eac92acbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:57:36 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-171f1cf1-e716-4552-8a4c-f87f7ec18c20 tempest-SnapshotsActionsTest-1388463594 None] Created volume successfully. Jul 07 21:57:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c2e81b92-e87c-4e28-9714-7cea6f6de78e tempest-SnapshotsActionsTest-1388463594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c2e81b92-e87c-4e28-9714-7cea6f6de78e tempest-SnapshotsActionsTest-1388463594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-c2e81b92-e87c-4e28-9714-7cea6f6de78e tempest-SnapshotsActionsTest-1388463594 None] Creating offline snapshot 8282494a-d8cb-420a-b83d-fb11611abeea of volume 7ba9e7a8-baf6-4501-8571-c108b1ca37aa {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 21:57:37 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[01791c62-0361-41b0-906c-04ba102b74d1]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:57:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c2e81b92-e87c-4e28-9714-7cea6f6de78e tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:37 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa Jul 07 21:57:37 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:38 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c2e81b92-e87c-4e28-9714-7cea6f6de78e tempest-SnapshotsActionsTest-1388463594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" returned: 0 in 1.021s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c2e81b92-e87c-4e28-9714-7cea6f6de78e tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:38 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea 1G Jul 07 21:57:38 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:38 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:57:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Flow 'volume_create_manager' (dfa83ae0-ce2d-4bbd-90e6-9a00032b339e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:57:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7c3cf5-d97b-46c5-85a2-cd3c0b2d06a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7c3cf5-d97b-46c5-85a2-cd3c0b2d06a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-656117007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca1b150-6671-4b07-aa58-75455ee079b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0cc9bd70723453f82fc5bb4569cde45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:57:39Z,use_quota=True,user_id='6ea59e60de3d4dcfb58481775cc83567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035ee1ab-6eef-4c8e-a0f8-7d7bd4dc22fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035ee1ab-6eef-4c8e-a0f8-7d7bd4dc22fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26691ab-22ed-4396-b72e-f33ead9fce72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26691ab-22ed-4396-b72e-f33ead9fce72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cca1b150-6671-4b07-aa58-75455ee079b1', 'volume_name': 'volume-cca1b150-6671-4b07-aa58-75455ee079b1', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6091048-8185-40ca-9cc4-dbc7b5adae47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6091048-8185-40ca-9cc4-dbc7b5adae47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad99773a-9b0a-410e-9a91-666b414562d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:38 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Volume cca1b150-6671-4b07-aa58-75455ee079b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cca1b150-6671-4b07-aa58-75455ee079b1', 'volume_size': 1} Jul 07 21:57:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:39 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c2e81b92-e87c-4e28-9714-7cea6f6de78e tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea 1G" returned: 0 in 0.908s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c2e81b92-e87c-4e28-9714-7cea6f6de78e tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:39 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea Jul 07 21:57:39 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:40 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c2e81b92-e87c-4e28-9714-7cea6f6de78e tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea" returned: 0 in 0.742s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:40 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-c2e81b92-e87c-4e28-9714-7cea6f6de78e tempest-SnapshotsActionsTest-1388463594 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea is being set with open permissions: ugo+rw Jul 07 21:57:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c2e81b92-e87c-4e28-9714-7cea6f6de78e tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:40 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea Jul 07 21:57:40 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:40 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c2e81b92-e87c-4e28-9714-7cea6f6de78e tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea" returned: 0 in 0.651s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c2e81b92-e87c-4e28-9714-7cea6f6de78e tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:41 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.info Jul 07 21:57:41 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:41 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c2e81b92-e87c-4e28-9714-7cea6f6de78e tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.info" returned: 0 in 0.729s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:41 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-c2e81b92-e87c-4e28-9714-7cea6f6de78e tempest-SnapshotsActionsTest-1388463594 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.info is being set with open permissions: ugo+rw Jul 07 21:57:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c2e81b92-e87c-4e28-9714-7cea6f6de78e tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:41 devstack sudo[93784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.info Jul 07 21:57:41 devstack sudo[93784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Flow 'volume_create_manager' (ef5dee49-d85e-4a40-a4d8-a285693ea62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35658df-30be-4bf9-8ca3-f1f440dc8c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35658df-30be-4bf9-8ca3-f1f440dc8c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1978446389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da4ca0c-c879-40a4-8698-af235e39c32c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90f09ca14f64ecda352e60cf18e450f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:57:42Z,use_quota=True,user_id='91df7198100d41d98450574ea2de2ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5a3b85-6340-4922-ba19-0c7c8b7b3e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5a3b85-6340-4922-ba19-0c7c8b7b3e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202da63a-46ba-4d11-94a0-78efb40a0131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202da63a-46ba-4d11-94a0-78efb40a0131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4da4ca0c-c879-40a4-8698-af235e39c32c', 'volume_name': 'volume-4da4ca0c-c879-40a4-8698-af235e39c32c', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f99cbe3-635a-4093-9161-1840580cdddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f99cbe3-635a-4093-9161-1840580cdddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd80c91-7def-49ad-a7a8-e11feb594c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:42 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Volume 4da4ca0c-c879-40a4-8698-af235e39c32c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4da4ca0c-c879-40a4-8698-af235e39c32c', 'volume_size': 1} Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:42 devstack sudo[93784]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c2e81b92-e87c-4e28-9714-7cea6f6de78e tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.info" returned: 0 in 0.639s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c2e81b92-e87c-4e28-9714-7cea6f6de78e tempest-SnapshotsActionsTest-1388463594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.784s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.576s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-656117007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca1b150-6671-4b07-aa58-75455ee079b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0cc9bd70723453f82fc5bb4569cde45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:57:39Z,use_quota=True,user_id='6ea59e60de3d4dcfb58481775cc83567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Creating volume cca1b150-6671-4b07-aa58-75455ee079b1 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:57:42 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:57:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-cca1b150-6671-4b07-aa58-75455ee079b1 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:42 devstack sudo[93788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-cca1b150-6671-4b07-aa58-75455ee079b1 1073741824 Jul 07 21:57:42 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:42 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-c2e81b92-e87c-4e28-9714-7cea6f6de78e tempest-SnapshotsActionsTest-1388463594 None] Create snapshot completed successfully Jul 07 21:57:43 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-cca1b150-6671-4b07-aa58-75455ee079b1 1073741824" returned: 0 in 0.934s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-cca1b150-6671-4b07-aa58-75455ee079b1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d7111d4e-dd05-4441-968f-7c80efb31588 tempest-SnapshotsActionsTest-1388463594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:43 devstack sudo[93795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-cca1b150-6671-4b07-aa58-75455ee079b1 Jul 07 21:57:43 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:44 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-cca1b150-6671-4b07-aa58-75455ee079b1" returned: 0 in 0.643s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:44 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:57:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.940s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:44 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1978446389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da4ca0c-c879-40a4-8698-af235e39c32c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90f09ca14f64ecda352e60cf18e450f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:57:42Z,use_quota=True,user_id='91df7198100d41d98450574ea2de2ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:57:44 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Creating volume 4da4ca0c-c879-40a4-8698-af235e39c32c {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:57:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:44 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:57:44 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:57:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:44 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:57:44 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:57:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4da4ca0c-c879-40a4-8698-af235e39c32c 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:44 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4da4ca0c-c879-40a4-8698-af235e39c32c 1073741824 Jul 07 21:57:44 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:44 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad99773a-9b0a-410e-9a91-666b414562d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cca1b150-6671-4b07-aa58-75455ee079b1', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:44 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb26e4a-192f-4ccb-804d-cd1ca371a226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:44 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Volume volume-cca1b150-6671-4b07-aa58-75455ee079b1 (cca1b150-6671-4b07-aa58-75455ee079b1): created successfully Jul 07 21:57:44 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb26e4a-192f-4ccb-804d-cd1ca371a226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:44 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Flow 'volume_create_manager' (dfa83ae0-ce2d-4bbd-90e6-9a00032b339e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:57:44 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-aeebde23-54a7-4041-845b-3a272938a16b tempest-AttachVolumeNegativeTest-648165259 None] Created volume successfully. Jul 07 21:57:44 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4da4ca0c-c879-40a4-8698-af235e39c32c 1073741824" returned: 0 in 0.868s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4da4ca0c-c879-40a4-8698-af235e39c32c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:44 devstack sudo[93807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4da4ca0c-c879-40a4-8698-af235e39c32c Jul 07 21:57:44 devstack sudo[93807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:45 devstack sudo[93807]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4da4ca0c-c879-40a4-8698-af235e39c32c" returned: 0 in 0.834s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:57:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d7111d4e-dd05-4441-968f-7c80efb31588 tempest-SnapshotsActionsTest-1388463594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.396s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-d7111d4e-dd05-4441-968f-7c80efb31588 tempest-SnapshotsActionsTest-1388463594 None] Creating offline snapshot 0b2661cd-11f0-4fbe-baa7-72304daa9b17 of volume 7ba9e7a8-baf6-4501-8571-c108b1ca37aa {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 21:57:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd80c91-7def-49ad-a7a8-e11feb594c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4da4ca0c-c879-40a4-8698-af235e39c32c', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ddd811f-634d-4f5c-b81a-1497740656ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:45 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b1e063-8c73-4bac-a1ad-3a1132fbdff7]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:57:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d7111d4e-dd05-4441-968f-7c80efb31588 tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:45 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Volume volume-4da4ca0c-c879-40a4-8698-af235e39c32c (4da4ca0c-c879-40a4-8698-af235e39c32c): created successfully Jul 07 21:57:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ddd811f-634d-4f5c-b81a-1497740656ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Flow 'volume_create_manager' (ef5dee49-d85e-4a40-a4d8-a285693ea62a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:57:45 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d85c4f74-a6e6-48e3-9a63-3ab6d8e1de71 tempest-AttachVolumeTestJSON-1149741386 None] Created volume successfully. Jul 07 21:57:45 devstack sudo[93830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea Jul 07 21:57:45 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:46 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d7111d4e-dd05-4441-968f-7c80efb31588 tempest-SnapshotsActionsTest-1388463594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea" returned: 0 in 0.785s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:46 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-d7111d4e-dd05-4441-968f-7c80efb31588 tempest-SnapshotsActionsTest-1388463594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 21:57:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d7111d4e-dd05-4441-968f-7c80efb31588 tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.0b2661cd-11f0-4fbe-baa7-72304daa9b17 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:46 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.0b2661cd-11f0-4fbe-baa7-72304daa9b17 1G Jul 07 21:57:46 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:47 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d7111d4e-dd05-4441-968f-7c80efb31588 tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.0b2661cd-11f0-4fbe-baa7-72304daa9b17 1G" returned: 0 in 0.840s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d7111d4e-dd05-4441-968f-7c80efb31588 tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.0b2661cd-11f0-4fbe-baa7-72304daa9b17 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:47 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.0b2661cd-11f0-4fbe-baa7-72304daa9b17 Jul 07 21:57:47 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-646c0b3d-f016-4b44-b213-5565135c07c4 req-06efd8d2-2dbb-4141-af7e-b43f01426da9 tempest-AttachVolumeNegativeTest-648165259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:48 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d7111d4e-dd05-4441-968f-7c80efb31588 tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.0b2661cd-11f0-4fbe-baa7-72304daa9b17" returned: 0 in 0.744s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:48 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-d7111d4e-dd05-4441-968f-7c80efb31588 tempest-SnapshotsActionsTest-1388463594 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.0b2661cd-11f0-4fbe-baa7-72304daa9b17 is being set with open permissions: ugo+rw Jul 07 21:57:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d7111d4e-dd05-4441-968f-7c80efb31588 tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.0b2661cd-11f0-4fbe-baa7-72304daa9b17 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:48 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.0b2661cd-11f0-4fbe-baa7-72304daa9b17 Jul 07 21:57:48 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-a87f7e15-ee46-4b51-8244-e728e34df631 req-92712343-43ae-4455-af03-8d80b9c29d91 tempest-AttachVolumeShelveTestJSON-1131525885 None] No connector for attachment 1fb3f40f-ba23-4304-ab71-c863106374ab; skipping storage backend terminate_connection call. {{(pid=87586) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5016}} Jul 07 21:57:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-a87f7e15-ee46-4b51-8244-e728e34df631 req-92712343-43ae-4455-af03-8d80b9c29d91 tempest-AttachVolumeShelveTestJSON-1131525885 None] Deleting attachment 1fb3f40f-ba23-4304-ab71-c863106374ab. {{(pid=87586) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 07 21:57:48 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d7111d4e-dd05-4441-968f-7c80efb31588 tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.0b2661cd-11f0-4fbe-baa7-72304daa9b17" returned: 0 in 0.655s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d7111d4e-dd05-4441-968f-7c80efb31588 tempest-SnapshotsActionsTest-1388463594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.142s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-646c0b3d-f016-4b44-b213-5565135c07c4 req-06efd8d2-2dbb-4141-af7e-b43f01426da9 tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.813s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:48 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1f6294-1a72-474b-ad57-b3373000b374]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:57:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-646c0b3d-f016-4b44-b213-5565135c07c4 req-06efd8d2-2dbb-4141-af7e-b43f01426da9 tempest-AttachVolumeNegativeTest-648165259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-cca1b150-6671-4b07-aa58-75455ee079b1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:48 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d7111d4e-dd05-4441-968f-7c80efb31588 tempest-SnapshotsActionsTest-1388463594 None] Create snapshot completed successfully Jul 07 21:57:49 devstack sudo[93863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-cca1b150-6671-4b07-aa58-75455ee079b1 Jul 07 21:57:49 devstack sudo[93863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:49 devstack sudo[93863]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-646c0b3d-f016-4b44-b213-5565135c07c4 req-06efd8d2-2dbb-4141-af7e-b43f01426da9 tempest-AttachVolumeNegativeTest-648165259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-cca1b150-6671-4b07-aa58-75455ee079b1" returned: 0 in 0.797s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-646c0b3d-f016-4b44-b213-5565135c07c4 req-06efd8d2-2dbb-4141-af7e-b43f01426da9 tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.816s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-646c0b3d-f016-4b44-b213-5565135c07c4 req-06efd8d2-2dbb-4141-af7e-b43f01426da9 tempest-AttachVolumeNegativeTest-648165259 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491', 'name': 'volume-cca1b150-6671-4b07-aa58-75455ee079b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67a50dcc-c717-46b8-9e86-60dd06d187cf', 'enforce_multipath': True} {{(pid=87586) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4930}} Jul 07 21:57:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-aca455d3-29a8-4a16-a88d-c3dc90313f99 req-f55a03b4-75a9-4058-ab0c-5a163426ae86 tempest-AttachVolumeTestJSON-1149741386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-aca455d3-29a8-4a16-a88d-c3dc90313f99 req-f55a03b4-75a9-4058-ab0c-5a163426ae86 tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:49 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9e73df-fc89-4b19-a00c-8ee278cd5f0f]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:57:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-aca455d3-29a8-4a16-a88d-c3dc90313f99 req-f55a03b4-75a9-4058-ab0c-5a163426ae86 tempest-AttachVolumeTestJSON-1149741386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4da4ca0c-c879-40a4-8698-af235e39c32c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:49 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-646c0b3d-f016-4b44-b213-5565135c07c4 req-06efd8d2-2dbb-4141-af7e-b43f01426da9 tempest-AttachVolumeNegativeTest-648165259 None] attachment_update completed successfully. Jul 07 21:57:49 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4da4ca0c-c879-40a4-8698-af235e39c32c Jul 07 21:57:49 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:50 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] Acquiring lock "cinder-0b2661cd-11f0-4fbe-baa7-72304daa9b17-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:57:50 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-0b2661cd-11f0-4fbe-baa7-72304daa9b17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:57:50 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] Acquiring lock "cinder-quobyte-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:57:50 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-quobyte-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:57:50 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] Acquiring lock "cinder-quobyte-0b2661cd-11f0-4fbe-baa7-72304daa9b17" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:57:50 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-quobyte-0b2661cd-11f0-4fbe-baa7-72304daa9b17" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:57:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] Deleting offline snapshot 0b2661cd-11f0-4fbe-baa7-72304daa9b17 of volume 7ba9e7a8-baf6-4501-8571-c108b1ca37aa {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 21:57:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] snapshot_file for this snap is: volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.0b2661cd-11f0-4fbe-baa7-72304daa9b17 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 21:57:50 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f92035-16ea-4c32-8304-c36df0242a36]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:57:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.0b2661cd-11f0-4fbe-baa7-72304daa9b17 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:50 devstack sudo[93949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.0b2661cd-11f0-4fbe-baa7-72304daa9b17 Jul 07 21:57:50 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:50 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-aca455d3-29a8-4a16-a88d-c3dc90313f99 req-f55a03b4-75a9-4058-ab0c-5a163426ae86 tempest-AttachVolumeTestJSON-1149741386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4da4ca0c-c879-40a4-8698-af235e39c32c" returned: 0 in 0.993s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-aca455d3-29a8-4a16-a88d-c3dc90313f99 req-f55a03b4-75a9-4058-ab0c-5a163426ae86 tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.014s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-aca455d3-29a8-4a16-a88d-c3dc90313f99 req-f55a03b4-75a9-4058-ab0c-5a163426ae86 tempest-AttachVolumeTestJSON-1149741386 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491', 'name': 'volume-4da4ca0c-c879-40a4-8698-af235e39c32c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74c08763-1e2b-4014-b344-9a3352a50a84', 'enforce_multipath': True} {{(pid=87586) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4930}} Jul 07 21:57:50 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-aca455d3-29a8-4a16-a88d-c3dc90313f99 req-f55a03b4-75a9-4058-ab0c-5a163426ae86 tempest-AttachVolumeTestJSON-1149741386 None] attachment_update completed successfully. Jul 07 21:57:51 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.0b2661cd-11f0-4fbe-baa7-72304daa9b17" returned: 0 in 0.963s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 21:57:51 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57a9c28-fa19-4577-9554-40f66b4e2162]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:57:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:51 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea Jul 07 21:57:51 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:52 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea" returned: 0 in 0.770s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 21:57:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.0b2661cd-11f0-4fbe-baa7-72304daa9b17 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:52 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.0b2661cd-11f0-4fbe-baa7-72304daa9b17 Jul 07 21:57:52 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:53 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.0b2661cd-11f0-4fbe-baa7-72304daa9b17" returned: 0 in 0.810s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.0b2661cd-11f0-4fbe-baa7-72304daa9b17 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:53 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.0b2661cd-11f0-4fbe-baa7-72304daa9b17 Jul 07 21:57:53 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:53 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.0b2661cd-11f0-4fbe-baa7-72304daa9b17" returned: 0 in 0.655s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:53 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-quobyte-0b2661cd-11f0-4fbe-baa7-72304daa9b17" released by "_delete_snapshot" :: held 3.340s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:57:53 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-quobyte-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" released by "delete_snapshot" :: held 3.381s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:57:53 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=70,cinder:UPDATE=66,cinder:DELETE=3,cinder:INSERT=12 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:57:53 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=67,cinder:UPDATE=61,cinder:INSERT=11,cinder:DELETE=6 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:57:53 devstack cinder-volume[87586]: WARNING cinder.quota [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 21:57:53 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] Created reservations ['eff07a72-a8fe-4c87-b270-d22947e6a544', 'e2a9fcdc-7c52-48bc-ad4f-e2714a9654ba', '1e5ff4d0-4c8f-4c78-9c8d-0b08d35b6362', 'dfa3326f-424c-4d25-ad84-4e9157239d5e'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:57:53 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] Delete snapshot completed successfully. Jul 07 21:57:53 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a28946aa-afa6-447b-b6c7-8b7b348c98bf tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-0b2661cd-11f0-4fbe-baa7-72304daa9b17-delete_snapshot" released by "delete_snapshot" :: held 3.572s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:57:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-60107f22-8ac9-413f-84a4-ef4f96f54ec0 tempest-SnapshotsActionsTest-1388463594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-60107f22-8ac9-413f-84a4-ef4f96f54ec0 tempest-SnapshotsActionsTest-1388463594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-60107f22-8ac9-413f-84a4-ef4f96f54ec0 tempest-SnapshotsActionsTest-1388463594 None] Creating offline snapshot d97cd585-243c-4475-8b54-8ecdf4a6817c of volume 7ba9e7a8-baf6-4501-8571-c108b1ca37aa {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 21:57:55 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c7b82f-8b00-46dc-ba2f-65be7c1801a5]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:57:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-60107f22-8ac9-413f-84a4-ef4f96f54ec0 tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:55 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea Jul 07 21:57:55 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:56 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:57:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Flow 'volume_create_manager' (25079438-0cc6-454b-8002-87b6f0321aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:57:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23179da4-34f7-4285-b038-1caad81a84d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23179da4-34f7-4285-b038-1caad81a84d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2067839254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e6a102-78aa-4cb7-846e-c0243bf423d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90f09ca14f64ecda352e60cf18e450f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:57:56Z,use_quota=True,user_id='91df7198100d41d98450574ea2de2ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3e197b-3c85-4434-b784-71a0aa3ad068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3e197b-3c85-4434-b784-71a0aa3ad068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9638076-874f-4444-90cc-ade21d17236b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9638076-874f-4444-90cc-ade21d17236b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7e6a102-78aa-4cb7-846e-c0243bf423d4', 'volume_name': 'volume-d7e6a102-78aa-4cb7-846e-c0243bf423d4', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dee0b8d-3313-45b6-b254-f86a35a21f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dee0b8d-3313-45b6-b254-f86a35a21f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:57:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00558aa3-2086-483a-9b1b-8b4ffde06aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:57:56 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Volume d7e6a102-78aa-4cb7-846e-c0243bf423d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7e6a102-78aa-4cb7-846e-c0243bf423d4', 'volume_size': 1} Jul 07 21:57:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:56 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-60107f22-8ac9-413f-84a4-ef4f96f54ec0 tempest-SnapshotsActionsTest-1388463594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea" returned: 0 in 1.088s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-60107f22-8ac9-413f-84a4-ef4f96f54ec0 tempest-SnapshotsActionsTest-1388463594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 21:57:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-60107f22-8ac9-413f-84a4-ef4f96f54ec0 tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d97cd585-243c-4475-8b54-8ecdf4a6817c 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:56 devstack sudo[94297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d97cd585-243c-4475-8b54-8ecdf4a6817c 1G Jul 07 21:57:56 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:57 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-60107f22-8ac9-413f-84a4-ef4f96f54ec0 tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d97cd585-243c-4475-8b54-8ecdf4a6817c 1G" returned: 0 in 0.956s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-60107f22-8ac9-413f-84a4-ef4f96f54ec0 tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d97cd585-243c-4475-8b54-8ecdf4a6817c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:57 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d97cd585-243c-4475-8b54-8ecdf4a6817c Jul 07 21:57:57 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:58 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-60107f22-8ac9-413f-84a4-ef4f96f54ec0 tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d97cd585-243c-4475-8b54-8ecdf4a6817c" returned: 0 in 0.819s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:58 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-60107f22-8ac9-413f-84a4-ef4f96f54ec0 tempest-SnapshotsActionsTest-1388463594 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d97cd585-243c-4475-8b54-8ecdf4a6817c is being set with open permissions: ugo+rw Jul 07 21:57:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-60107f22-8ac9-413f-84a4-ef4f96f54ec0 tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d97cd585-243c-4475-8b54-8ecdf4a6817c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:58 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d97cd585-243c-4475-8b54-8ecdf4a6817c Jul 07 21:57:58 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:58 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-60107f22-8ac9-413f-84a4-ef4f96f54ec0 tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d97cd585-243c-4475-8b54-8ecdf4a6817c" returned: 0 in 0.751s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-60107f22-8ac9-413f-84a4-ef4f96f54ec0 tempest-SnapshotsActionsTest-1388463594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.770s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.695s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2067839254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e6a102-78aa-4cb7-846e-c0243bf423d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90f09ca14f64ecda352e60cf18e450f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:57:56Z,use_quota=True,user_id='91df7198100d41d98450574ea2de2ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:57:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Creating volume d7e6a102-78aa-4cb7-846e-c0243bf423d4 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:57:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:57:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:57:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:57:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:57:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:57:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:57:58 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:57:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d7e6a102-78aa-4cb7-846e-c0243bf423d4 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:58 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d7e6a102-78aa-4cb7-846e-c0243bf423d4 1073741824 Jul 07 21:57:58 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:58 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-60107f22-8ac9-413f-84a4-ef4f96f54ec0 tempest-SnapshotsActionsTest-1388463594 None] Create snapshot completed successfully Jul 07 21:57:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] Acquiring lock "cinder-d97cd585-243c-4475-8b54-8ecdf4a6817c-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:57:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-d97cd585-243c-4475-8b54-8ecdf4a6817c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:57:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] Acquiring lock "cinder-quobyte-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:57:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-quobyte-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:57:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] Acquiring lock "cinder-quobyte-d97cd585-243c-4475-8b54-8ecdf4a6817c" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:57:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-quobyte-d97cd585-243c-4475-8b54-8ecdf4a6817c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:57:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] Deleting offline snapshot d97cd585-243c-4475-8b54-8ecdf4a6817c of volume 7ba9e7a8-baf6-4501-8571-c108b1ca37aa {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 21:57:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] snapshot_file for this snap is: volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d97cd585-243c-4475-8b54-8ecdf4a6817c {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 21:57:59 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de14838-ddfb-4ffe-8e2e-527ad9422462]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:57:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d97cd585-243c-4475-8b54-8ecdf4a6817c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:59 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d97cd585-243c-4475-8b54-8ecdf4a6817c Jul 07 21:57:59 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:57:59 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Jul 07 21:57:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d7e6a102-78aa-4cb7-846e-c0243bf423d4 1073741824" returned: 0 in 0.978s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:57:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d7e6a102-78aa-4cb7-846e-c0243bf423d4 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:57:59 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d7e6a102-78aa-4cb7-846e-c0243bf423d4 Jul 07 21:57:59 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:00 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d97cd585-243c-4475-8b54-8ecdf4a6817c" returned: 0 in 1.088s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 21:58:00 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[63438627-ffb3-4781-bba6-e1038272a160]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:58:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:00 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea Jul 07 21:58:00 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:00 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d7e6a102-78aa-4cb7-846e-c0243bf423d4" returned: 0 in 1.032s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:58:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:58:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00558aa3-2086-483a-9b1b-8b4ffde06aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7e6a102-78aa-4cb7-846e-c0243bf423d4', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:58:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf19198d-8826-46ef-8754-7a6083e5c3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:58:00 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Volume volume-d7e6a102-78aa-4cb7-846e-c0243bf423d4 (d7e6a102-78aa-4cb7-846e-c0243bf423d4): created successfully Jul 07 21:58:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf19198d-8826-46ef-8754-7a6083e5c3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:58:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Flow 'volume_create_manager' (25079438-0cc6-454b-8002-87b6f0321aa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:58:00 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-03147c49-2e48-4fbf-92cf-e0d379f76e4e tempest-AttachVolumeTestJSON-1149741386 None] Created volume successfully. Jul 07 21:58:01 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea" returned: 0 in 0.981s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:01 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 21:58:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d97cd585-243c-4475-8b54-8ecdf4a6817c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:01 devstack sudo[94338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d97cd585-243c-4475-8b54-8ecdf4a6817c Jul 07 21:58:01 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:02 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d97cd585-243c-4475-8b54-8ecdf4a6817c" returned: 0 in 0.943s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d97cd585-243c-4475-8b54-8ecdf4a6817c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:02 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d97cd585-243c-4475-8b54-8ecdf4a6817c Jul 07 21:58:02 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:03 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d97cd585-243c-4475-8b54-8ecdf4a6817c" returned: 0 in 0.842s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:03 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-quobyte-d97cd585-243c-4475-8b54-8ecdf4a6817c" released by "_delete_snapshot" :: held 3.969s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:03 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-quobyte-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" released by "delete_snapshot" :: held 3.993s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:03 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] Created reservations ['aa0092e1-49cc-42d2-b6c6-a2047a339e56', 'b1817755-fa4a-4a93-8991-afa05c511387', 'bfb46b5a-0f59-4ca0-ab4e-e1dc5c8d5976', '606bd7b2-ffaa-42b0-8ece-e681b535a084'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:58:03 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] Delete snapshot completed successfully. Jul 07 21:58:03 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f51c020d-c5d5-403d-b4d0-e9910eab027b tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-d97cd585-243c-4475-8b54-8ecdf4a6817c-delete_snapshot" released by "delete_snapshot" :: held 4.197s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-69244606-8e82-4f6c-a893-120593da659d tempest-SnapshotsActionsTest-1388463594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:58:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-69244606-8e82-4f6c-a893-120593da659d tempest-SnapshotsActionsTest-1388463594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:58:04 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-69244606-8e82-4f6c-a893-120593da659d tempest-SnapshotsActionsTest-1388463594 None] Creating offline snapshot 10f3b2c6-3278-42c7-97cb-ea5a8a14552a of volume 7ba9e7a8-baf6-4501-8571-c108b1ca37aa {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 21:58:04 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5d1c20-8589-4a8e-97d7-d1baf758c4ea]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:58:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69244606-8e82-4f6c-a893-120593da659d tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:04 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea Jul 07 21:58:04 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-d583d6a1-0600-4f89-ae95-8bd28399f131 req-4d1fab4c-038b-468c-8155-4a2656b3146f tempest-AttachVolumeTestJSON-1149741386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:58:05 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69244606-8e82-4f6c-a893-120593da659d tempest-SnapshotsActionsTest-1388463594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea" returned: 0 in 1.090s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:05 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-69244606-8e82-4f6c-a893-120593da659d tempest-SnapshotsActionsTest-1388463594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 21:58:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69244606-8e82-4f6c-a893-120593da659d tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.10f3b2c6-3278-42c7-97cb-ea5a8a14552a 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:05 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.10f3b2c6-3278-42c7-97cb-ea5a8a14552a 1G Jul 07 21:58:05 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:06 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69244606-8e82-4f6c-a893-120593da659d tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.10f3b2c6-3278-42c7-97cb-ea5a8a14552a 1G" returned: 0 in 0.932s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69244606-8e82-4f6c-a893-120593da659d tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.10f3b2c6-3278-42c7-97cb-ea5a8a14552a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:06 devstack sudo[94422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.10f3b2c6-3278-42c7-97cb-ea5a8a14552a Jul 07 21:58:06 devstack sudo[94422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:07 devstack sudo[94422]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69244606-8e82-4f6c-a893-120593da659d tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.10f3b2c6-3278-42c7-97cb-ea5a8a14552a" returned: 0 in 0.895s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:07 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-69244606-8e82-4f6c-a893-120593da659d tempest-SnapshotsActionsTest-1388463594 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.10f3b2c6-3278-42c7-97cb-ea5a8a14552a is being set with open permissions: ugo+rw Jul 07 21:58:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69244606-8e82-4f6c-a893-120593da659d tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.10f3b2c6-3278-42c7-97cb-ea5a8a14552a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:07 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.10f3b2c6-3278-42c7-97cb-ea5a8a14552a Jul 07 21:58:07 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:08 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69244606-8e82-4f6c-a893-120593da659d tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.10f3b2c6-3278-42c7-97cb-ea5a8a14552a" returned: 0 in 0.748s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-69244606-8e82-4f6c-a893-120593da659d tempest-SnapshotsActionsTest-1388463594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.922s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:58:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-d583d6a1-0600-4f89-ae95-8bd28399f131 req-4d1fab4c-038b-468c-8155-4a2656b3146f tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.269s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:58:08 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e2ff66-8ad6-496e-ba5a-e1c52785d64b]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:58:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-d583d6a1-0600-4f89-ae95-8bd28399f131 req-4d1fab4c-038b-468c-8155-4a2656b3146f tempest-AttachVolumeTestJSON-1149741386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d7e6a102-78aa-4cb7-846e-c0243bf423d4 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:08 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-69244606-8e82-4f6c-a893-120593da659d tempest-SnapshotsActionsTest-1388463594 None] Create snapshot completed successfully Jul 07 21:58:08 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d7e6a102-78aa-4cb7-846e-c0243bf423d4 Jul 07 21:58:08 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] Acquiring lock "cinder-10f3b2c6-3278-42c7-97cb-ea5a8a14552a-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:58:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-10f3b2c6-3278-42c7-97cb-ea5a8a14552a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:58:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] Acquiring lock "cinder-quobyte-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:58:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-quobyte-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:58:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] Acquiring lock "cinder-quobyte-10f3b2c6-3278-42c7-97cb-ea5a8a14552a" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:58:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-quobyte-10f3b2c6-3278-42c7-97cb-ea5a8a14552a" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:58:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] Deleting offline snapshot 10f3b2c6-3278-42c7-97cb-ea5a8a14552a of volume 7ba9e7a8-baf6-4501-8571-c108b1ca37aa {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 21:58:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] snapshot_file for this snap is: volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.10f3b2c6-3278-42c7-97cb-ea5a8a14552a {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 21:58:08 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[15abefe8-9c97-40ab-a732-a3e1310655ad]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:58:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.10f3b2c6-3278-42c7-97cb-ea5a8a14552a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:08 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.10f3b2c6-3278-42c7-97cb-ea5a8a14552a Jul 07 21:58:08 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:09 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-d583d6a1-0600-4f89-ae95-8bd28399f131 req-4d1fab4c-038b-468c-8155-4a2656b3146f tempest-AttachVolumeTestJSON-1149741386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d7e6a102-78aa-4cb7-846e-c0243bf423d4" returned: 0 in 1.009s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-d583d6a1-0600-4f89-ae95-8bd28399f131 req-4d1fab4c-038b-468c-8155-4a2656b3146f tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.042s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:58:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-d583d6a1-0600-4f89-ae95-8bd28399f131 req-4d1fab4c-038b-468c-8155-4a2656b3146f tempest-AttachVolumeTestJSON-1149741386 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491', 'name': 'volume-d7e6a102-78aa-4cb7-846e-c0243bf423d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '830db123-4cb0-480e-91ef-a24d11dd5fbe', 'enforce_multipath': True} {{(pid=87586) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4930}} Jul 07 21:58:09 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-d583d6a1-0600-4f89-ae95-8bd28399f131 req-4d1fab4c-038b-468c-8155-4a2656b3146f tempest-AttachVolumeTestJSON-1149741386 None] attachment_update completed successfully. Jul 07 21:58:09 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.10f3b2c6-3278-42c7-97cb-ea5a8a14552a" returned: 0 in 0.932s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 21:58:09 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0078550-8e90-4e59-9f63-f41e00d8e5b5]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:58:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:09 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea Jul 07 21:58:09 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:10 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea" returned: 0 in 1.367s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:11 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 21:58:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.10f3b2c6-3278-42c7-97cb-ea5a8a14552a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:11 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.10f3b2c6-3278-42c7-97cb-ea5a8a14552a Jul 07 21:58:11 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:12 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.10f3b2c6-3278-42c7-97cb-ea5a8a14552a" returned: 0 in 1.109s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.10f3b2c6-3278-42c7-97cb-ea5a8a14552a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:12 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.10f3b2c6-3278-42c7-97cb-ea5a8a14552a Jul 07 21:58:12 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:12 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.10f3b2c6-3278-42c7-97cb-ea5a8a14552a" returned: 0 in 0.815s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-quobyte-10f3b2c6-3278-42c7-97cb-ea5a8a14552a" released by "_delete_snapshot" :: held 4.415s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-quobyte-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" released by "delete_snapshot" :: held 4.464s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:13 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] Created reservations ['5d2222c1-22bc-4b2b-b89f-07d1f70ce21e', '39066d83-1107-444e-8344-5dd28f4719d6', '11b3a5c7-2292-44c6-8d6a-8eae6d15a502', '88433140-8a10-413b-8163-4db134b99e4e'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:58:13 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] Delete snapshot completed successfully. Jul 07 21:58:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f28c0c42-5770-4cfa-aa7c-e28f89235cf6 tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-10f3b2c6-3278-42c7-97cb-ea5a8a14552a-delete_snapshot" released by "delete_snapshot" :: held 4.871s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ad77ec0d-06e2-4a80-bd10-7e7030610431 tempest-SnapshotsActionsTest-1388463594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:58:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ad77ec0d-06e2-4a80-bd10-7e7030610431 tempest-SnapshotsActionsTest-1388463594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:58:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-ad77ec0d-06e2-4a80-bd10-7e7030610431 tempest-SnapshotsActionsTest-1388463594 None] Creating offline snapshot d5de2643-7463-4250-b55c-a940ec1064d6 of volume 7ba9e7a8-baf6-4501-8571-c108b1ca37aa {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 21:58:14 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70f2592-6867-4113-8482-9cc3c1da635b]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:58:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ad77ec0d-06e2-4a80-bd10-7e7030610431 tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:14 devstack sudo[94601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea Jul 07 21:58:14 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:15 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ad77ec0d-06e2-4a80-bd10-7e7030610431 tempest-SnapshotsActionsTest-1388463594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea" returned: 0 in 1.008s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-ad77ec0d-06e2-4a80-bd10-7e7030610431 tempest-SnapshotsActionsTest-1388463594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 21:58:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ad77ec0d-06e2-4a80-bd10-7e7030610431 tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d5de2643-7463-4250-b55c-a940ec1064d6 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:15 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d5de2643-7463-4250-b55c-a940ec1064d6 1G Jul 07 21:58:15 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:16 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-14f65003-39e5-4aee-9023-014b7bb96bf0 req-0411a9bd-1b29-4ed2-a47a-e009a0a14a77 tempest-AttachVolumeTestJSON-1149741386 None] Terminate volume connection completed successfully. Jul 07 21:58:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-14f65003-39e5-4aee-9023-014b7bb96bf0 req-0411a9bd-1b29-4ed2-a47a-e009a0a14a77 tempest-AttachVolumeTestJSON-1149741386 None] Deleting attachment 74c08763-1e2b-4014-b344-9a3352a50a84. {{(pid=87586) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 07 21:58:16 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ad77ec0d-06e2-4a80-bd10-7e7030610431 tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d5de2643-7463-4250-b55c-a940ec1064d6 1G" returned: 0 in 1.407s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ad77ec0d-06e2-4a80-bd10-7e7030610431 tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d5de2643-7463-4250-b55c-a940ec1064d6 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:16 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d5de2643-7463-4250-b55c-a940ec1064d6 Jul 07 21:58:16 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:18 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ad77ec0d-06e2-4a80-bd10-7e7030610431 tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d5de2643-7463-4250-b55c-a940ec1064d6" returned: 0 in 1.361s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:18 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-ad77ec0d-06e2-4a80-bd10-7e7030610431 tempest-SnapshotsActionsTest-1388463594 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d5de2643-7463-4250-b55c-a940ec1064d6 is being set with open permissions: ugo+rw Jul 07 21:58:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ad77ec0d-06e2-4a80-bd10-7e7030610431 tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d5de2643-7463-4250-b55c-a940ec1064d6 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:18 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d5de2643-7463-4250-b55c-a940ec1064d6 Jul 07 21:58:18 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:18 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ad77ec0d-06e2-4a80-bd10-7e7030610431 tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d5de2643-7463-4250-b55c-a940ec1064d6" returned: 0 in 0.770s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ad77ec0d-06e2-4a80-bd10-7e7030610431 tempest-SnapshotsActionsTest-1388463594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.697s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:58:19 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ad77ec0d-06e2-4a80-bd10-7e7030610431 tempest-SnapshotsActionsTest-1388463594 None] Create snapshot completed successfully Jul 07 21:58:19 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-e579900b-817e-426c-a858-2d759d8990ae req-fe8f4b5d-9182-4c3c-abc9-b43cc57b501a tempest-AttachVolumeTestJSON-1149741386 None] Terminate volume connection completed successfully. Jul 07 21:58:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-e579900b-817e-426c-a858-2d759d8990ae req-fe8f4b5d-9182-4c3c-abc9-b43cc57b501a tempest-AttachVolumeTestJSON-1149741386 None] Deleting attachment 830db123-4cb0-480e-91ef-a24d11dd5fbe. {{(pid=87586) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 07 21:58:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] Acquiring lock "cinder-d5de2643-7463-4250-b55c-a940ec1064d6-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:58:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-d5de2643-7463-4250-b55c-a940ec1064d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:58:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] Acquiring lock "cinder-quobyte-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:58:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-quobyte-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:58:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] Acquiring lock "cinder-quobyte-d5de2643-7463-4250-b55c-a940ec1064d6" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:58:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-quobyte-d5de2643-7463-4250-b55c-a940ec1064d6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:58:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] Deleting offline snapshot d5de2643-7463-4250-b55c-a940ec1064d6 of volume 7ba9e7a8-baf6-4501-8571-c108b1ca37aa {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 21:58:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] snapshot_file for this snap is: volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d5de2643-7463-4250-b55c-a940ec1064d6 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 21:58:19 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ca0b45-e98d-4d25-88f7-80a202aaf1b9]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:58:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d5de2643-7463-4250-b55c-a940ec1064d6 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:19 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d5de2643-7463-4250-b55c-a940ec1064d6 Jul 07 21:58:19 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:20 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d5de2643-7463-4250-b55c-a940ec1064d6" returned: 0 in 0.872s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 21:58:20 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75078fe-e7aa-43ef-bc9f-492d4d1f6250]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:58:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:20 devstack sudo[94641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea Jul 07 21:58:20 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:21 devstack sudo[94641]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea" returned: 0 in 0.854s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 21:58:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d5de2643-7463-4250-b55c-a940ec1064d6 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:21 devstack sudo[94654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d5de2643-7463-4250-b55c-a940ec1064d6 Jul 07 21:58:21 devstack sudo[94654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:23 devstack sudo[94654]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d5de2643-7463-4250-b55c-a940ec1064d6" returned: 0 in 1.399s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d5de2643-7463-4250-b55c-a940ec1064d6 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:23 devstack sudo[94678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d5de2643-7463-4250-b55c-a940ec1064d6 Jul 07 21:58:23 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:23 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.d5de2643-7463-4250-b55c-a940ec1064d6" returned: 0 in 0.725s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:23 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-quobyte-d5de2643-7463-4250-b55c-a940ec1064d6" released by "_delete_snapshot" :: held 3.947s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:23 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-quobyte-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" released by "delete_snapshot" :: held 3.979s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:23 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] Created reservations ['126e0af8-f4e0-45f4-af52-ba86c936d2b2', '973611e1-8b7c-40fa-9cf4-056b4b11acb4', '62c334dd-176c-450d-a40c-0eaad9341086', '7f405e99-6d99-4fc0-a1cf-2d66ede90eec'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:58:23 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] Delete snapshot completed successfully. Jul 07 21:58:23 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6fadde40-57d8-487d-a894-e2e83bc63cbb tempest-SnapshotsActionsTest-67448559 None] Lock "cinder-d5de2643-7463-4250-b55c-a940ec1064d6-delete_snapshot" released by "delete_snapshot" :: held 4.133s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-22d77cda-4032-4688-b1bb-899778070281 tempest-SnapshotsActionsTest-1388463594 None] Acquiring lock "cinder-8282494a-d8cb-420a-b83d-fb11611abeea-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:58:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-22d77cda-4032-4688-b1bb-899778070281 tempest-SnapshotsActionsTest-1388463594 None] Lock "cinder-8282494a-d8cb-420a-b83d-fb11611abeea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:58:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-22d77cda-4032-4688-b1bb-899778070281 tempest-SnapshotsActionsTest-1388463594 None] Acquiring lock "cinder-quobyte-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:58:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-22d77cda-4032-4688-b1bb-899778070281 tempest-SnapshotsActionsTest-1388463594 None] Lock "cinder-quobyte-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:58:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-22d77cda-4032-4688-b1bb-899778070281 tempest-SnapshotsActionsTest-1388463594 None] Acquiring lock "cinder-quobyte-8282494a-d8cb-420a-b83d-fb11611abeea" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:58:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-22d77cda-4032-4688-b1bb-899778070281 tempest-SnapshotsActionsTest-1388463594 None] Lock "cinder-quobyte-8282494a-d8cb-420a-b83d-fb11611abeea" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:58:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-22d77cda-4032-4688-b1bb-899778070281 tempest-SnapshotsActionsTest-1388463594 None] Deleting offline snapshot 8282494a-d8cb-420a-b83d-fb11611abeea of volume 7ba9e7a8-baf6-4501-8571-c108b1ca37aa {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 21:58:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-22d77cda-4032-4688-b1bb-899778070281 tempest-SnapshotsActionsTest-1388463594 None] snapshot_file for this snap is: volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 21:58:24 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4281be-ae81-47c5-93b7-54f35da59914]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:58:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-22d77cda-4032-4688-b1bb-899778070281 tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:25 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea Jul 07 21:58:25 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:25 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-22d77cda-4032-4688-b1bb-899778070281 tempest-SnapshotsActionsTest-1388463594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea" returned: 0 in 0.896s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-22d77cda-4032-4688-b1bb-899778070281 tempest-SnapshotsActionsTest-1388463594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 21:58:25 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ee10c5-ec42-4bae-8c30-c54855802b22]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:58:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-22d77cda-4032-4688-b1bb-899778070281 tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:25 devstack sudo[94718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa Jul 07 21:58:25 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:26 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-22d77cda-4032-4688-b1bb-899778070281 tempest-SnapshotsActionsTest-1388463594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" returned: 0 in 0.838s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-22d77cda-4032-4688-b1bb-899778070281 tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:26 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea Jul 07 21:58:26 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:27 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-22d77cda-4032-4688-b1bb-899778070281 tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea" returned: 0 in 0.768s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-22d77cda-4032-4688-b1bb-899778070281 tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:27 devstack sudo[94749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea Jul 07 21:58:27 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:28 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-22d77cda-4032-4688-b1bb-899778070281 tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa.8282494a-d8cb-420a-b83d-fb11611abeea" returned: 0 in 0.660s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-22d77cda-4032-4688-b1bb-899778070281 tempest-SnapshotsActionsTest-1388463594 None] Lock "cinder-quobyte-8282494a-d8cb-420a-b83d-fb11611abeea" released by "_delete_snapshot" :: held 3.278s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-22d77cda-4032-4688-b1bb-899778070281 tempest-SnapshotsActionsTest-1388463594 None] Lock "cinder-quobyte-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" released by "delete_snapshot" :: held 3.301s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:28 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-22d77cda-4032-4688-b1bb-899778070281 tempest-SnapshotsActionsTest-1388463594 None] Created reservations ['1c554ff8-2c9f-401c-8d1b-f498991e5dc7', '678f12fa-aea3-428c-9f1e-857129b3410e', 'a640451a-11fa-4ffa-b795-3bc35e59ab7b', '384950c4-5672-4c08-946b-f1a803f04afc'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:58:28 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-22d77cda-4032-4688-b1bb-899778070281 tempest-SnapshotsActionsTest-1388463594 None] Delete snapshot completed successfully. Jul 07 21:58:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-22d77cda-4032-4688-b1bb-899778070281 tempest-SnapshotsActionsTest-1388463594 None] Lock "cinder-8282494a-d8cb-420a-b83d-fb11611abeea-delete_snapshot" released by "delete_snapshot" :: held 3.432s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-42c9ebe7-866d-442c-aa38-43250010cca6 tempest-SnapshotsActionsTest-1388463594 None] Acquiring lock "cinder-7ba9e7a8-baf6-4501-8571-c108b1ca37aa-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:58:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-42c9ebe7-866d-442c-aa38-43250010cca6 tempest-SnapshotsActionsTest-1388463594 None] Lock "cinder-7ba9e7a8-baf6-4501-8571-c108b1ca37aa-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:58:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-42c9ebe7-866d-442c-aa38-43250010cca6 tempest-SnapshotsActionsTest-1388463594 None] Acquiring lock "cinder-quobyte-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:58:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-42c9ebe7-866d-442c-aa38-43250010cca6 tempest-SnapshotsActionsTest-1388463594 None] Lock "cinder-quobyte-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" acquired by "delete_volume" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:58:29 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb4b9e4-fd2e-4f34-89fc-0f029c77ddac]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:58:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-42c9ebe7-866d-442c-aa38-43250010cca6 tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:29 devstack sudo[94778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa Jul 07 21:58:29 devstack sudo[94778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:30 devstack sudo[94778]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-42c9ebe7-866d-442c-aa38-43250010cca6 tempest-SnapshotsActionsTest-1388463594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" returned: 0 in 1.049s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-42c9ebe7-866d-442c-aa38-43250010cca6 tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:30 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa Jul 07 21:58:30 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:31 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-42c9ebe7-866d-442c-aa38-43250010cca6 tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" returned: 0 in 0.750s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-42c9ebe7-866d-442c-aa38-43250010cca6 tempest-SnapshotsActionsTest-1388463594 None] Lock "cinder-quobyte-7ba9e7a8-baf6-4501-8571-c108b1ca37aa" released by "delete_volume" :: held 1.928s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:31 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-42c9ebe7-866d-442c-aa38-43250010cca6 tempest-SnapshotsActionsTest-1388463594 None] Created reservations ['6410ea09-9bff-4973-930c-1667920af4ae', 'dff725d6-25e2-4637-8455-acd901b53e16', 'ea0c21bc-7ab8-4fff-bf12-55569c9dafb6', '1a5f727a-9649-499e-bc5d-82a4a99d958e'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:58:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-42c9ebe7-866d-442c-aa38-43250010cca6 tempest-SnapshotsActionsTest-1388463594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:58:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-42c9ebe7-866d-442c-aa38-43250010cca6 tempest-SnapshotsActionsTest-1388463594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:58:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-42c9ebe7-866d-442c-aa38-43250010cca6 tempest-SnapshotsActionsTest-1388463594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:58:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-42c9ebe7-866d-442c-aa38-43250010cca6 tempest-SnapshotsActionsTest-1388463594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:58:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-42c9ebe7-866d-442c-aa38-43250010cca6 tempest-SnapshotsActionsTest-1388463594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:58:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-42c9ebe7-866d-442c-aa38-43250010cca6 tempest-SnapshotsActionsTest-1388463594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:31 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:58:31 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1160d60f-38eb-4e37-a2ad-07bb70a3349a tempest-AttachVolumeTestJSON-1149741386 None] Acquiring lock "cinder-d7e6a102-78aa-4cb7-846e-c0243bf423d4-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:58:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1160d60f-38eb-4e37-a2ad-07bb70a3349a tempest-AttachVolumeTestJSON-1149741386 None] Lock "cinder-d7e6a102-78aa-4cb7-846e-c0243bf423d4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:58:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1160d60f-38eb-4e37-a2ad-07bb70a3349a tempest-AttachVolumeTestJSON-1149741386 None] Acquiring lock "cinder-quobyte-d7e6a102-78aa-4cb7-846e-c0243bf423d4" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:58:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1160d60f-38eb-4e37-a2ad-07bb70a3349a tempest-AttachVolumeTestJSON-1149741386 None] Lock "cinder-quobyte-d7e6a102-78aa-4cb7-846e-c0243bf423d4" acquired by "delete_volume" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:58:31 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6e6d27-e4ea-4e8f-aa14-237296c438f5]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:58:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1160d60f-38eb-4e37-a2ad-07bb70a3349a tempest-AttachVolumeTestJSON-1149741386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d7e6a102-78aa-4cb7-846e-c0243bf423d4 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:31 devstack sudo[94803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d7e6a102-78aa-4cb7-846e-c0243bf423d4 Jul 07 21:58:31 devstack sudo[94803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:32 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-42c9ebe7-866d-442c-aa38-43250010cca6 tempest-SnapshotsActionsTest-1388463594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.755s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:32 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-42c9ebe7-866d-442c-aa38-43250010cca6 tempest-SnapshotsActionsTest-1388463594 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:58:32 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-42c9ebe7-866d-442c-aa38-43250010cca6 tempest-SnapshotsActionsTest-1388463594 None] Deleted volume successfully. Jul 07 21:58:32 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-42c9ebe7-866d-442c-aa38-43250010cca6 tempest-SnapshotsActionsTest-1388463594 None] Lock "cinder-7ba9e7a8-baf6-4501-8571-c108b1ca37aa-delete_volume" released by "delete_volume" :: held 3.007s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:32 devstack sudo[94803]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1160d60f-38eb-4e37-a2ad-07bb70a3349a tempest-AttachVolumeTestJSON-1149741386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d7e6a102-78aa-4cb7-846e-c0243bf423d4" returned: 0 in 0.802s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1160d60f-38eb-4e37-a2ad-07bb70a3349a tempest-AttachVolumeTestJSON-1149741386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d7e6a102-78aa-4cb7-846e-c0243bf423d4 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:32 devstack sudo[94810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d7e6a102-78aa-4cb7-846e-c0243bf423d4 Jul 07 21:58:32 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:33 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1160d60f-38eb-4e37-a2ad-07bb70a3349a tempest-AttachVolumeTestJSON-1149741386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d7e6a102-78aa-4cb7-846e-c0243bf423d4" returned: 0 in 0.825s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1160d60f-38eb-4e37-a2ad-07bb70a3349a tempest-AttachVolumeTestJSON-1149741386 None] Lock "cinder-quobyte-d7e6a102-78aa-4cb7-846e-c0243bf423d4" released by "delete_volume" :: held 1.686s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:33 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-1160d60f-38eb-4e37-a2ad-07bb70a3349a tempest-AttachVolumeTestJSON-1149741386 None] Created reservations ['930f7e65-b4e3-40c2-9177-0c21124c5f88', '5e22e18d-0ab8-427f-9671-c1a6c333c3bd', '5fd30c88-806d-4595-9c14-a6136d267eb8', 'c02c1c71-02fe-4b68-8bb4-918e66202dfd'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:58:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1160d60f-38eb-4e37-a2ad-07bb70a3349a tempest-AttachVolumeTestJSON-1149741386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:58:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1160d60f-38eb-4e37-a2ad-07bb70a3349a tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:58:33 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1160d60f-38eb-4e37-a2ad-07bb70a3349a tempest-AttachVolumeTestJSON-1149741386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:58:33 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1160d60f-38eb-4e37-a2ad-07bb70a3349a tempest-AttachVolumeTestJSON-1149741386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:58:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1160d60f-38eb-4e37-a2ad-07bb70a3349a tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:58:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1160d60f-38eb-4e37-a2ad-07bb70a3349a tempest-AttachVolumeTestJSON-1149741386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:33 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:58:33 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b23261e4-e0ed-4468-bee8-80ce073beee4 tempest-AttachVolumeTestJSON-1149741386 None] Acquiring lock "cinder-4da4ca0c-c879-40a4-8698-af235e39c32c-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:58:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b23261e4-e0ed-4468-bee8-80ce073beee4 tempest-AttachVolumeTestJSON-1149741386 None] Lock "cinder-4da4ca0c-c879-40a4-8698-af235e39c32c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:58:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b23261e4-e0ed-4468-bee8-80ce073beee4 tempest-AttachVolumeTestJSON-1149741386 None] Acquiring lock "cinder-quobyte-4da4ca0c-c879-40a4-8698-af235e39c32c" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:58:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b23261e4-e0ed-4468-bee8-80ce073beee4 tempest-AttachVolumeTestJSON-1149741386 None] Lock "cinder-quobyte-4da4ca0c-c879-40a4-8698-af235e39c32c" acquired by "delete_volume" :: waited 0.023s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:58:34 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f706b81d-b5f5-40d2-9f73-ea2e37ec5c30]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:58:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b23261e4-e0ed-4468-bee8-80ce073beee4 tempest-AttachVolumeTestJSON-1149741386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4da4ca0c-c879-40a4-8698-af235e39c32c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:34 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4da4ca0c-c879-40a4-8698-af235e39c32c Jul 07 21:58:34 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:34 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1160d60f-38eb-4e37-a2ad-07bb70a3349a tempest-AttachVolumeTestJSON-1149741386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.802s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:34 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-1160d60f-38eb-4e37-a2ad-07bb70a3349a tempest-AttachVolumeTestJSON-1149741386 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:58:34 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-1160d60f-38eb-4e37-a2ad-07bb70a3349a tempest-AttachVolumeTestJSON-1149741386 None] Deleted volume successfully. Jul 07 21:58:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1160d60f-38eb-4e37-a2ad-07bb70a3349a tempest-AttachVolumeTestJSON-1149741386 None] Lock "cinder-d7e6a102-78aa-4cb7-846e-c0243bf423d4-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:35 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b23261e4-e0ed-4468-bee8-80ce073beee4 tempest-AttachVolumeTestJSON-1149741386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4da4ca0c-c879-40a4-8698-af235e39c32c" returned: 0 in 1.065s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b23261e4-e0ed-4468-bee8-80ce073beee4 tempest-AttachVolumeTestJSON-1149741386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4da4ca0c-c879-40a4-8698-af235e39c32c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:35 devstack sudo[94845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4da4ca0c-c879-40a4-8698-af235e39c32c Jul 07 21:58:35 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:58:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:58:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:58:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:58:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:58:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:58:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:35 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:58:35 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:36 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b23261e4-e0ed-4468-bee8-80ce073beee4 tempest-AttachVolumeTestJSON-1149741386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4da4ca0c-c879-40a4-8698-af235e39c32c" returned: 0 in 0.800s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b23261e4-e0ed-4468-bee8-80ce073beee4 tempest-AttachVolumeTestJSON-1149741386 None] Lock "cinder-quobyte-4da4ca0c-c879-40a4-8698-af235e39c32c" released by "delete_volume" :: held 1.940s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:36 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-b23261e4-e0ed-4468-bee8-80ce073beee4 tempest-AttachVolumeTestJSON-1149741386 None] Created reservations ['09ff0e41-7229-4c70-b770-89872c1aabc6', '4c89dc4e-1c06-49ea-8a88-586e81dd6bb1', '3ac3a9da-501d-4efa-b748-2fa3a7202b4c', '655048e3-fbf5-4a35-904f-7dc2b08d8c4b'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:58:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b23261e4-e0ed-4468-bee8-80ce073beee4 tempest-AttachVolumeTestJSON-1149741386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:58:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b23261e4-e0ed-4468-bee8-80ce073beee4 tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:58:36 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b23261e4-e0ed-4468-bee8-80ce073beee4 tempest-AttachVolumeTestJSON-1149741386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:58:36 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b23261e4-e0ed-4468-bee8-80ce073beee4 tempest-AttachVolumeTestJSON-1149741386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:58:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b23261e4-e0ed-4468-bee8-80ce073beee4 tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:58:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b23261e4-e0ed-4468-bee8-80ce073beee4 tempest-AttachVolumeTestJSON-1149741386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:36 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:58:36 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:36 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.990s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:58:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:58:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 8 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 21:58:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 21:58:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9797ee5c-2773-49bd-9a9d-d98b2cfb65e9 tempest-AttachVolumeTestJSON-1149741386 None] Acquiring lock "cinder-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:58:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9797ee5c-2773-49bd-9a9d-d98b2cfb65e9 tempest-AttachVolumeTestJSON-1149741386 None] Lock "cinder-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:58:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9797ee5c-2773-49bd-9a9d-d98b2cfb65e9 tempest-AttachVolumeTestJSON-1149741386 None] Acquiring lock "cinder-quobyte-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:58:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9797ee5c-2773-49bd-9a9d-d98b2cfb65e9 tempest-AttachVolumeTestJSON-1149741386 None] Lock "cinder-quobyte-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912" acquired by "delete_volume" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:58:36 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ef93c1-0b92-4adb-a99b-8601f769b831]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:58:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9797ee5c-2773-49bd-9a9d-d98b2cfb65e9 tempest-AttachVolumeTestJSON-1149741386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:36 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912 Jul 07 21:58:36 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:37 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b23261e4-e0ed-4468-bee8-80ce073beee4 tempest-AttachVolumeTestJSON-1149741386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.013s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:37 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-b23261e4-e0ed-4468-bee8-80ce073beee4 tempest-AttachVolumeTestJSON-1149741386 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:58:37 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-b23261e4-e0ed-4468-bee8-80ce073beee4 tempest-AttachVolumeTestJSON-1149741386 None] Deleted volume successfully. Jul 07 21:58:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b23261e4-e0ed-4468-bee8-80ce073beee4 tempest-AttachVolumeTestJSON-1149741386 None] Lock "cinder-4da4ca0c-c879-40a4-8698-af235e39c32c-delete_volume" released by "delete_volume" :: held 3.363s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:37 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9797ee5c-2773-49bd-9a9d-d98b2cfb65e9 tempest-AttachVolumeTestJSON-1149741386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912" returned: 0 in 1.000s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9797ee5c-2773-49bd-9a9d-d98b2cfb65e9 tempest-AttachVolumeTestJSON-1149741386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:37 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912 Jul 07 21:58:37 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:38 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9797ee5c-2773-49bd-9a9d-d98b2cfb65e9 tempest-AttachVolumeTestJSON-1149741386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912" returned: 0 in 0.778s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:38 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9797ee5c-2773-49bd-9a9d-d98b2cfb65e9 tempest-AttachVolumeTestJSON-1149741386 None] Lock "cinder-quobyte-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912" released by "delete_volume" :: held 1.835s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:38 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-9797ee5c-2773-49bd-9a9d-d98b2cfb65e9 tempest-AttachVolumeTestJSON-1149741386 None] Created reservations ['983fac8b-bdca-44d0-a9d2-413d6182943f', 'bedc8f0d-32c1-4246-9f18-98eecef297fe', 'db0c7ecb-a77f-43da-b7c3-8e9cee423c7f', 'fabfc749-323e-44cb-9793-c1e31016f6ed'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:58:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9797ee5c-2773-49bd-9a9d-d98b2cfb65e9 tempest-AttachVolumeTestJSON-1149741386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:58:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9797ee5c-2773-49bd-9a9d-d98b2cfb65e9 tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:58:38 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9797ee5c-2773-49bd-9a9d-d98b2cfb65e9 tempest-AttachVolumeTestJSON-1149741386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:58:38 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9797ee5c-2773-49bd-9a9d-d98b2cfb65e9 tempest-AttachVolumeTestJSON-1149741386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:58:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9797ee5c-2773-49bd-9a9d-d98b2cfb65e9 tempest-AttachVolumeTestJSON-1149741386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:58:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9797ee5c-2773-49bd-9a9d-d98b2cfb65e9 tempest-AttachVolumeTestJSON-1149741386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:38 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:58:38 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:39 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9797ee5c-2773-49bd-9a9d-d98b2cfb65e9 tempest-AttachVolumeTestJSON-1149741386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.913s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:39 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-9797ee5c-2773-49bd-9a9d-d98b2cfb65e9 tempest-AttachVolumeTestJSON-1149741386 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:58:39 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-9797ee5c-2773-49bd-9a9d-d98b2cfb65e9 tempest-AttachVolumeTestJSON-1149741386 None] Deleted volume successfully. Jul 07 21:58:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9797ee5c-2773-49bd-9a9d-d98b2cfb65e9 tempest-AttachVolumeTestJSON-1149741386 None] Lock "cinder-a68a81f2-7b04-4e66-9d2f-0f4c6ee8c912-delete_volume" released by "delete_volume" :: held 2.998s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ba43d647-c8cf-451b-b735-43625b29643a tempest-AttachVolumeShelveTestJSON-1131525885 None] Acquiring lock "cinder-8bba6fd7-3076-4286-b07b-922917007c47-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:58:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ba43d647-c8cf-451b-b735-43625b29643a tempest-AttachVolumeShelveTestJSON-1131525885 None] Lock "cinder-8bba6fd7-3076-4286-b07b-922917007c47-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:58:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ba43d647-c8cf-451b-b735-43625b29643a tempest-AttachVolumeShelveTestJSON-1131525885 None] Acquiring lock "cinder-quobyte-8bba6fd7-3076-4286-b07b-922917007c47" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:58:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ba43d647-c8cf-451b-b735-43625b29643a tempest-AttachVolumeShelveTestJSON-1131525885 None] Lock "cinder-quobyte-8bba6fd7-3076-4286-b07b-922917007c47" acquired by "delete_volume" :: waited 0.025s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:58:43 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e5fbf5-da13-4b62-b82a-c7857be7b401]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:58:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba43d647-c8cf-451b-b735-43625b29643a tempest-AttachVolumeShelveTestJSON-1131525885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bba6fd7-3076-4286-b07b-922917007c47 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:43 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bba6fd7-3076-4286-b07b-922917007c47 Jul 07 21:58:43 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:44 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba43d647-c8cf-451b-b735-43625b29643a tempest-AttachVolumeShelveTestJSON-1131525885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bba6fd7-3076-4286-b07b-922917007c47" returned: 0 in 1.023s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba43d647-c8cf-451b-b735-43625b29643a tempest-AttachVolumeShelveTestJSON-1131525885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bba6fd7-3076-4286-b07b-922917007c47 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:44 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bba6fd7-3076-4286-b07b-922917007c47 Jul 07 21:58:44 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:44 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba43d647-c8cf-451b-b735-43625b29643a tempest-AttachVolumeShelveTestJSON-1131525885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bba6fd7-3076-4286-b07b-922917007c47" returned: 0 in 0.770s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:44 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ba43d647-c8cf-451b-b735-43625b29643a tempest-AttachVolumeShelveTestJSON-1131525885 None] Lock "cinder-quobyte-8bba6fd7-3076-4286-b07b-922917007c47" released by "delete_volume" :: held 1.858s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:45 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-ba43d647-c8cf-451b-b735-43625b29643a tempest-AttachVolumeShelveTestJSON-1131525885 None] Created reservations ['667550aa-97f3-414e-9c3e-3407f72f647b', '6c049d01-241d-459e-912d-587de1443267', 'b3f9e38c-79d9-4fb2-b6df-b3c05971ccfa', 'fc3fb1f1-2764-498a-b8bc-83600c579b22'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:58:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ba43d647-c8cf-451b-b735-43625b29643a tempest-AttachVolumeShelveTestJSON-1131525885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:58:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ba43d647-c8cf-451b-b735-43625b29643a tempest-AttachVolumeShelveTestJSON-1131525885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:58:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ba43d647-c8cf-451b-b735-43625b29643a tempest-AttachVolumeShelveTestJSON-1131525885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:58:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ba43d647-c8cf-451b-b735-43625b29643a tempest-AttachVolumeShelveTestJSON-1131525885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:58:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ba43d647-c8cf-451b-b735-43625b29643a tempest-AttachVolumeShelveTestJSON-1131525885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:58:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba43d647-c8cf-451b-b735-43625b29643a tempest-AttachVolumeShelveTestJSON-1131525885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:45 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:58:45 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:45 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba43d647-c8cf-451b-b735-43625b29643a tempest-AttachVolumeShelveTestJSON-1131525885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.797s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:45 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-ba43d647-c8cf-451b-b735-43625b29643a tempest-AttachVolumeShelveTestJSON-1131525885 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:58:46 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ba43d647-c8cf-451b-b735-43625b29643a tempest-AttachVolumeShelveTestJSON-1131525885 None] Deleted volume successfully. Jul 07 21:58:46 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ba43d647-c8cf-451b-b735-43625b29643a tempest-AttachVolumeShelveTestJSON-1131525885 None] Lock "cinder-8bba6fd7-3076-4286-b07b-922917007c47-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:48 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:58:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Flow 'volume_create_manager' (b2aef77c-b78e-4b8c-a993-6e14474baede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:58:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (288e5563-2d18-433e-b551-31583082b432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:58:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (288e5563-2d18-433e-b551-31583082b432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1716561276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d7d460f-7c84-4cec-9960-6cbcf7464eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8f093216b24d839a3e7d4082029131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:58:48Z,use_quota=True,user_id='0dc2be60db25415d948e3c33c3969a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:58:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ed587f-64e3-4c86-b19c-c644d8905cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:58:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ed587f-64e3-4c86-b19c-c644d8905cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:58:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e280509-19e5-4928-a31d-d5530d3704eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:58:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e280509-19e5-4928-a31d-d5530d3704eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d7d460f-7c84-4cec-9960-6cbcf7464eda', 'volume_name': 'volume-0d7d460f-7c84-4cec-9960-6cbcf7464eda', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:58:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d793ad3-223b-4348-b7bc-2cf951ebe3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:58:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d793ad3-223b-4348-b7bc-2cf951ebe3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:58:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0b56ab-029f-486d-82d1-9fc55afc298e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:58:48 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Volume 0d7d460f-7c84-4cec-9960-6cbcf7464eda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d7d460f-7c84-4cec-9960-6cbcf7464eda', 'volume_size': 1} Jul 07 21:58:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:58:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:58:48 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1716561276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d7d460f-7c84-4cec-9960-6cbcf7464eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8f093216b24d839a3e7d4082029131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:58:48Z,use_quota=True,user_id='0dc2be60db25415d948e3c33c3969a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:58:48 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Creating volume 0d7d460f-7c84-4cec-9960-6cbcf7464eda {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:58:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:58:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:58:48 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:58:48 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:58:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:58:48 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:58:48 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:58:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0d7d460f-7c84-4cec-9960-6cbcf7464eda 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:48 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0d7d460f-7c84-4cec-9960-6cbcf7464eda 1073741824 Jul 07 21:58:48 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:48 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6b63eaa4-bc80-4a3f-9a3a-e5518f20c9e5 tempest-GroupsV320Test-175139024 None] Group tempest-GroupsV320Test-Group-854498056: creating Jul 07 21:58:48 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6b63eaa4-bc80-4a3f-9a3a-e5518f20c9e5 tempest-GroupsV320Test-175139024 None] Group tempest-GroupsV320Test-Group-854498056: created successfully Jul 07 21:58:48 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6b63eaa4-bc80-4a3f-9a3a-e5518f20c9e5 tempest-GroupsV320Test-175139024 None] Create group completed successfully. Jul 07 21:58:49 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-72d0c814-1c60-42b0-9042-f16ba36c566a req-c190c8d0-7754-406d-80c8-2ea975656af8 tempest-AttachVolumeNegativeTest-648165259 None] Terminate volume connection completed successfully. Jul 07 21:58:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-72d0c814-1c60-42b0-9042-f16ba36c566a req-c190c8d0-7754-406d-80c8-2ea975656af8 tempest-AttachVolumeNegativeTest-648165259 None] Deleting attachment 67a50dcc-c717-46b8-9e86-60dd06d187cf. {{(pid=87586) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 07 21:58:49 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0d7d460f-7c84-4cec-9960-6cbcf7464eda 1073741824" returned: 0 in 1.070s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0d7d460f-7c84-4cec-9960-6cbcf7464eda {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:49 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0d7d460f-7c84-4cec-9960-6cbcf7464eda Jul 07 21:58:49 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:50 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0d7d460f-7c84-4cec-9960-6cbcf7464eda" returned: 0 in 0.858s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] <== create_volume: return (1974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:58:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:58:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0b56ab-029f-486d-82d1-9fc55afc298e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d7d460f-7c84-4cec-9960-6cbcf7464eda', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:58:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8aecfc8-c88d-4a5a-99a6-a725fb127335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:58:50 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Volume volume-0d7d460f-7c84-4cec-9960-6cbcf7464eda (0d7d460f-7c84-4cec-9960-6cbcf7464eda): created successfully Jul 07 21:58:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8aecfc8-c88d-4a5a-99a6-a725fb127335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:58:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Flow 'volume_create_manager' (b2aef77c-b78e-4b8c-a993-6e14474baede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:58:50 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-3d6e62d3-cac0-4ef6-9406-b147bea16fd5 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Created volume successfully. Jul 07 21:58:50 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-71132e48-015d-472b-83aa-7573c58bd38d tempest-GroupsV320Test-175139024 None] Created reservations ['d99dfd76-ddcc-45d2-be3d-b37813403825'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:58:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-71132e48-015d-472b-83aa-7573c58bd38d tempest-GroupsV320Test-175139024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:58:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-71132e48-015d-472b-83aa-7573c58bd38d tempest-GroupsV320Test-175139024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:58:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-71132e48-015d-472b-83aa-7573c58bd38d tempest-GroupsV320Test-175139024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:58:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-71132e48-015d-472b-83aa-7573c58bd38d tempest-GroupsV320Test-175139024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:58:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-71132e48-015d-472b-83aa-7573c58bd38d tempest-GroupsV320Test-175139024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:58:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-71132e48-015d-472b-83aa-7573c58bd38d tempest-GroupsV320Test-175139024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:50 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:58:50 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:51 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-71132e48-015d-472b-83aa-7573c58bd38d tempest-GroupsV320Test-175139024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.731s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:51 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-71132e48-015d-472b-83aa-7573c58bd38d tempest-GroupsV320Test-175139024 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:58:51 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-71132e48-015d-472b-83aa-7573c58bd38d tempest-GroupsV320Test-175139024 None] Delete group completed successfully. Jul 07 21:58:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7185ed4b-bbb9-40e3-be1f-f3e73bb0e932 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Acquiring lock "cinder-0d7d460f-7c84-4cec-9960-6cbcf7464eda-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:58:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7185ed4b-bbb9-40e3-be1f-f3e73bb0e932 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Lock "cinder-0d7d460f-7c84-4cec-9960-6cbcf7464eda-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:58:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7185ed4b-bbb9-40e3-be1f-f3e73bb0e932 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Acquiring lock "cinder-quobyte-0d7d460f-7c84-4cec-9960-6cbcf7464eda" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:58:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7185ed4b-bbb9-40e3-be1f-f3e73bb0e932 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Lock "cinder-quobyte-0d7d460f-7c84-4cec-9960-6cbcf7464eda" acquired by "delete_volume" :: waited 0.022s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:58:52 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ab2771-c441-459c-93f1-1bd83e763c4f]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:58:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7185ed4b-bbb9-40e3-be1f-f3e73bb0e932 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0d7d460f-7c84-4cec-9960-6cbcf7464eda {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:52 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0d7d460f-7c84-4cec-9960-6cbcf7464eda Jul 07 21:58:52 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:53 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7185ed4b-bbb9-40e3-be1f-f3e73bb0e932 tempest-VolumeQuotasNegativeTestJSON-199976128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0d7d460f-7c84-4cec-9960-6cbcf7464eda" returned: 0 in 1.221s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7185ed4b-bbb9-40e3-be1f-f3e73bb0e932 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0d7d460f-7c84-4cec-9960-6cbcf7464eda {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:54 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0d7d460f-7c84-4cec-9960-6cbcf7464eda Jul 07 21:58:54 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:54 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7185ed4b-bbb9-40e3-be1f-f3e73bb0e932 tempest-VolumeQuotasNegativeTestJSON-199976128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0d7d460f-7c84-4cec-9960-6cbcf7464eda" returned: 0 in 0.991s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:54 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7185ed4b-bbb9-40e3-be1f-f3e73bb0e932 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Lock "cinder-quobyte-0d7d460f-7c84-4cec-9960-6cbcf7464eda" released by "delete_volume" :: held 2.275s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:54 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=73,cinder:INSERT=21,cinder:UPDATE=73,cinder:DELETE=6 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:INSERT=22,cinder:UPDATE=91,cinder:SELECT=79,cinder:DELETE=4 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-7185ed4b-bbb9-40e3-be1f-f3e73bb0e932 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Created reservations ['f9bfd393-b46b-4e1b-91a5-7fe8f7dcb9bd', 'e833097e-68b8-4370-80ef-495d4a9c35b9', '0fa40050-36a6-44dc-a146-dd37b1b6dbbb', 'be3acfea-bbe7-49a1-9a22-23de3aa94308'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7185ed4b-bbb9-40e3-be1f-f3e73bb0e932 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7185ed4b-bbb9-40e3-be1f-f3e73bb0e932 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7185ed4b-bbb9-40e3-be1f-f3e73bb0e932 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7185ed4b-bbb9-40e3-be1f-f3e73bb0e932 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7185ed4b-bbb9-40e3-be1f-f3e73bb0e932 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7185ed4b-bbb9-40e3-be1f-f3e73bb0e932 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:55 devstack sudo[94967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:58:55 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Flow 'volume_create_manager' (095fd305-0205-401d-a625-876186ba69f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c7d5d5-4310-4602-8114-708194a60547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c7d5d5-4310-4602-8114-708194a60547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-41934619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2bfa55b-e50c-4dd5-a7a5-448ff430d851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ae816a84e945439deb627de48842de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:58:55Z,use_quota=True,user_id='e83947ec0a8d4305867dc55f58261a6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a773e58c-c852-4c7f-bdd3-e3f98268803d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a773e58c-c852-4c7f-bdd3-e3f98268803d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98fee3d-21a6-4c6d-8c04-a4ce7b62ef69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98fee3d-21a6-4c6d-8c04-a4ce7b62ef69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2bfa55b-e50c-4dd5-a7a5-448ff430d851', 'volume_name': 'volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409de614-2294-4bea-b04a-89c45e5a097b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409de614-2294-4bea-b04a-89c45e5a097b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7300be9f-053c-46e9-b560-23776968c3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:58:55 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Volume f2bfa55b-e50c-4dd5-a7a5-448ff430d851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851', 'volume_size': 1} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-41934619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2bfa55b-e50c-4dd5-a7a5-448ff430d851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ae816a84e945439deb627de48842de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:58:55Z,use_quota=True,user_id='e83947ec0a8d4305867dc55f58261a6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Creating volume f2bfa55b-e50c-4dd5-a7a5-448ff430d851 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:58:55 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:58:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:55 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851 1073741824 Jul 07 21:58:55 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:56 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7185ed4b-bbb9-40e3-be1f-f3e73bb0e932 tempest-VolumeQuotasNegativeTestJSON-199976128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.746s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:56 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-7185ed4b-bbb9-40e3-be1f-f3e73bb0e932 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:58:56 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-7185ed4b-bbb9-40e3-be1f-f3e73bb0e932 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Deleted volume successfully. Jul 07 21:58:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7185ed4b-bbb9-40e3-be1f-f3e73bb0e932 tempest-VolumeQuotasNegativeTestJSON-199976128 None] Lock "cinder-0d7d460f-7c84-4cec-9960-6cbcf7464eda-delete_volume" released by "delete_volume" :: held 3.428s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:58:56 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851 1073741824" returned: 0 in 0.990s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:56 devstack sudo[94975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851 Jul 07 21:58:56 devstack sudo[94975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:57 devstack sudo[94975]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851" returned: 0 in 0.712s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:58:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:58:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7300be9f-053c-46e9-b560-23776968c3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:58:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc82b9e-b148-4348-b083-6720ab67e6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:58:57 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Volume volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851 (f2bfa55b-e50c-4dd5-a7a5-448ff430d851): created successfully Jul 07 21:58:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc82b9e-b148-4348-b083-6720ab67e6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:58:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Flow 'volume_create_manager' (095fd305-0205-401d-a625-876186ba69f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:58:57 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-4f6d8dfb-bf43-44e4-bf2c-2cf86fafae04 req-110c0dd4-27b1-449c-8bcc-a60d8775939b tempest-VolumesSnapshotsTestJSON-94770957 None] Created volume successfully. Jul 07 21:58:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-5137289a-5f77-476a-a688-2a8f889c19af req-c1f5576e-b7c1-45d6-a2df-3acdfba1a09a tempest-VolumesSnapshotsTestJSON-94770957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:58:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-5137289a-5f77-476a-a688-2a8f889c19af req-c1f5576e-b7c1-45d6-a2df-3acdfba1a09a tempest-VolumesSnapshotsTestJSON-94770957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:58:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [req-5137289a-5f77-476a-a688-2a8f889c19af req-c1f5576e-b7c1-45d6-a2df-3acdfba1a09a tempest-VolumesSnapshotsTestJSON-94770957 None] Creating offline snapshot 6ffb2d46-800d-40f3-b541-3d0a59bb17ed of volume f2bfa55b-e50c-4dd5-a7a5-448ff430d851 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 21:58:57 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01df190-b9d5-46cc-9265-9869592ab7fe]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:58:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-5137289a-5f77-476a-a688-2a8f889c19af req-c1f5576e-b7c1-45d6-a2df-3acdfba1a09a tempest-VolumesSnapshotsTestJSON-94770957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:58 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851 Jul 07 21:58:58 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:58:59 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Jul 07 21:58:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-5137289a-5f77-476a-a688-2a8f889c19af req-c1f5576e-b7c1-45d6-a2df-3acdfba1a09a tempest-VolumesSnapshotsTestJSON-94770957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851" returned: 0 in 1.149s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:58:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-5137289a-5f77-476a-a688-2a8f889c19af req-c1f5576e-b7c1-45d6-a2df-3acdfba1a09a tempest-VolumesSnapshotsTestJSON-94770957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.6ffb2d46-800d-40f3-b541-3d0a59bb17ed 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:58:59 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.6ffb2d46-800d-40f3-b541-3d0a59bb17ed 1G Jul 07 21:58:59 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:00 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-5137289a-5f77-476a-a688-2a8f889c19af req-c1f5576e-b7c1-45d6-a2df-3acdfba1a09a tempest-VolumesSnapshotsTestJSON-94770957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.6ffb2d46-800d-40f3-b541-3d0a59bb17ed 1G" returned: 0 in 0.976s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-5137289a-5f77-476a-a688-2a8f889c19af req-c1f5576e-b7c1-45d6-a2df-3acdfba1a09a tempest-VolumesSnapshotsTestJSON-94770957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.6ffb2d46-800d-40f3-b541-3d0a59bb17ed {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:00 devstack sudo[94989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.6ffb2d46-800d-40f3-b541-3d0a59bb17ed Jul 07 21:59:00 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:01 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-5137289a-5f77-476a-a688-2a8f889c19af req-c1f5576e-b7c1-45d6-a2df-3acdfba1a09a tempest-VolumesSnapshotsTestJSON-94770957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.6ffb2d46-800d-40f3-b541-3d0a59bb17ed" returned: 0 in 0.904s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:01 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [req-5137289a-5f77-476a-a688-2a8f889c19af req-c1f5576e-b7c1-45d6-a2df-3acdfba1a09a tempest-VolumesSnapshotsTestJSON-94770957 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.6ffb2d46-800d-40f3-b541-3d0a59bb17ed is being set with open permissions: ugo+rw Jul 07 21:59:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-5137289a-5f77-476a-a688-2a8f889c19af req-c1f5576e-b7c1-45d6-a2df-3acdfba1a09a tempest-VolumesSnapshotsTestJSON-94770957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.6ffb2d46-800d-40f3-b541-3d0a59bb17ed {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:01 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.6ffb2d46-800d-40f3-b541-3d0a59bb17ed Jul 07 21:59:01 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:01 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-5137289a-5f77-476a-a688-2a8f889c19af req-c1f5576e-b7c1-45d6-a2df-3acdfba1a09a tempest-VolumesSnapshotsTestJSON-94770957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.6ffb2d46-800d-40f3-b541-3d0a59bb17ed" returned: 0 in 0.760s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-5137289a-5f77-476a-a688-2a8f889c19af req-c1f5576e-b7c1-45d6-a2df-3acdfba1a09a tempest-VolumesSnapshotsTestJSON-94770957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:01 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.info Jul 07 21:59:01 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:02 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-5137289a-5f77-476a-a688-2a8f889c19af req-c1f5576e-b7c1-45d6-a2df-3acdfba1a09a tempest-VolumesSnapshotsTestJSON-94770957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.info" returned: 0 in 0.891s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:02 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [req-5137289a-5f77-476a-a688-2a8f889c19af req-c1f5576e-b7c1-45d6-a2df-3acdfba1a09a tempest-VolumesSnapshotsTestJSON-94770957 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.info is being set with open permissions: ugo+rw Jul 07 21:59:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-5137289a-5f77-476a-a688-2a8f889c19af req-c1f5576e-b7c1-45d6-a2df-3acdfba1a09a tempest-VolumesSnapshotsTestJSON-94770957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:02 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.info Jul 07 21:59:02 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:03 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-5137289a-5f77-476a-a688-2a8f889c19af req-c1f5576e-b7c1-45d6-a2df-3acdfba1a09a tempest-VolumesSnapshotsTestJSON-94770957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.info" returned: 0 in 0.863s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-5137289a-5f77-476a-a688-2a8f889c19af req-c1f5576e-b7c1-45d6-a2df-3acdfba1a09a tempest-VolumesSnapshotsTestJSON-94770957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.701s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:03 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-5137289a-5f77-476a-a688-2a8f889c19af req-c1f5576e-b7c1-45d6-a2df-3acdfba1a09a tempest-VolumesSnapshotsTestJSON-94770957 None] Create snapshot completed successfully Jul 07 21:59:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-2fbca030-4c7f-4e09-b2a6-d7e21c059430 req-6cfee1f3-8b45-4289-8f4b-4f7a8ff61d70 tempest-VolumesSnapshotsTestJSON-94770957 None] Acquiring lock "cinder-6ffb2d46-800d-40f3-b541-3d0a59bb17ed-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:59:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-2fbca030-4c7f-4e09-b2a6-d7e21c059430 req-6cfee1f3-8b45-4289-8f4b-4f7a8ff61d70 tempest-VolumesSnapshotsTestJSON-94770957 None] Lock "cinder-6ffb2d46-800d-40f3-b541-3d0a59bb17ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:59:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-2fbca030-4c7f-4e09-b2a6-d7e21c059430 req-6cfee1f3-8b45-4289-8f4b-4f7a8ff61d70 tempest-VolumesSnapshotsTestJSON-94770957 None] Acquiring lock "cinder-quobyte-f2bfa55b-e50c-4dd5-a7a5-448ff430d851" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:59:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-2fbca030-4c7f-4e09-b2a6-d7e21c059430 req-6cfee1f3-8b45-4289-8f4b-4f7a8ff61d70 tempest-VolumesSnapshotsTestJSON-94770957 None] Lock "cinder-quobyte-f2bfa55b-e50c-4dd5-a7a5-448ff430d851" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:59:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-2fbca030-4c7f-4e09-b2a6-d7e21c059430 req-6cfee1f3-8b45-4289-8f4b-4f7a8ff61d70 tempest-VolumesSnapshotsTestJSON-94770957 None] Acquiring lock "cinder-quobyte-6ffb2d46-800d-40f3-b541-3d0a59bb17ed" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:59:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-2fbca030-4c7f-4e09-b2a6-d7e21c059430 req-6cfee1f3-8b45-4289-8f4b-4f7a8ff61d70 tempest-VolumesSnapshotsTestJSON-94770957 None] Lock "cinder-quobyte-6ffb2d46-800d-40f3-b541-3d0a59bb17ed" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:59:04 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [req-2fbca030-4c7f-4e09-b2a6-d7e21c059430 req-6cfee1f3-8b45-4289-8f4b-4f7a8ff61d70 tempest-VolumesSnapshotsTestJSON-94770957 None] Deleting offline snapshot 6ffb2d46-800d-40f3-b541-3d0a59bb17ed of volume f2bfa55b-e50c-4dd5-a7a5-448ff430d851 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 21:59:04 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [req-2fbca030-4c7f-4e09-b2a6-d7e21c059430 req-6cfee1f3-8b45-4289-8f4b-4f7a8ff61d70 tempest-VolumesSnapshotsTestJSON-94770957 None] snapshot_file for this snap is: volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.6ffb2d46-800d-40f3-b541-3d0a59bb17ed {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 21:59:04 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[902896a1-4e04-4589-b323-bc05f6f5280a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:59:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-2fbca030-4c7f-4e09-b2a6-d7e21c059430 req-6cfee1f3-8b45-4289-8f4b-4f7a8ff61d70 tempest-VolumesSnapshotsTestJSON-94770957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.6ffb2d46-800d-40f3-b541-3d0a59bb17ed {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:04 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.6ffb2d46-800d-40f3-b541-3d0a59bb17ed Jul 07 21:59:04 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:05 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-2fbca030-4c7f-4e09-b2a6-d7e21c059430 req-6cfee1f3-8b45-4289-8f4b-4f7a8ff61d70 tempest-VolumesSnapshotsTestJSON-94770957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.6ffb2d46-800d-40f3-b541-3d0a59bb17ed" returned: 0 in 0.930s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:05 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [req-2fbca030-4c7f-4e09-b2a6-d7e21c059430 req-6cfee1f3-8b45-4289-8f4b-4f7a8ff61d70 tempest-VolumesSnapshotsTestJSON-94770957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 21:59:05 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[daba24a7-3602-44bb-b460-88861cb724b3]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:59:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-2fbca030-4c7f-4e09-b2a6-d7e21c059430 req-6cfee1f3-8b45-4289-8f4b-4f7a8ff61d70 tempest-VolumesSnapshotsTestJSON-94770957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:05 devstack sudo[95014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851 Jul 07 21:59:05 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:05 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-2fbca030-4c7f-4e09-b2a6-d7e21c059430 req-6cfee1f3-8b45-4289-8f4b-4f7a8ff61d70 tempest-VolumesSnapshotsTestJSON-94770957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851" returned: 0 in 0.848s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-2fbca030-4c7f-4e09-b2a6-d7e21c059430 req-6cfee1f3-8b45-4289-8f4b-4f7a8ff61d70 tempest-VolumesSnapshotsTestJSON-94770957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.6ffb2d46-800d-40f3-b541-3d0a59bb17ed {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:05 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.6ffb2d46-800d-40f3-b541-3d0a59bb17ed Jul 07 21:59:05 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:06 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-2fbca030-4c7f-4e09-b2a6-d7e21c059430 req-6cfee1f3-8b45-4289-8f4b-4f7a8ff61d70 tempest-VolumesSnapshotsTestJSON-94770957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.6ffb2d46-800d-40f3-b541-3d0a59bb17ed" returned: 0 in 0.830s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-2fbca030-4c7f-4e09-b2a6-d7e21c059430 req-6cfee1f3-8b45-4289-8f4b-4f7a8ff61d70 tempest-VolumesSnapshotsTestJSON-94770957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.6ffb2d46-800d-40f3-b541-3d0a59bb17ed {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:06 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.6ffb2d46-800d-40f3-b541-3d0a59bb17ed Jul 07 21:59:06 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:07 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-2fbca030-4c7f-4e09-b2a6-d7e21c059430 req-6cfee1f3-8b45-4289-8f4b-4f7a8ff61d70 tempest-VolumesSnapshotsTestJSON-94770957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851.6ffb2d46-800d-40f3-b541-3d0a59bb17ed" returned: 0 in 0.726s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-2fbca030-4c7f-4e09-b2a6-d7e21c059430 req-6cfee1f3-8b45-4289-8f4b-4f7a8ff61d70 tempest-VolumesSnapshotsTestJSON-94770957 None] Lock "cinder-quobyte-6ffb2d46-800d-40f3-b541-3d0a59bb17ed" released by "_delete_snapshot" :: held 3.474s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:59:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-2fbca030-4c7f-4e09-b2a6-d7e21c059430 req-6cfee1f3-8b45-4289-8f4b-4f7a8ff61d70 tempest-VolumesSnapshotsTestJSON-94770957 None] Lock "cinder-quobyte-f2bfa55b-e50c-4dd5-a7a5-448ff430d851" released by "delete_snapshot" :: held 3.505s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:59:07 devstack cinder-volume[87586]: DEBUG cinder.quota [req-2fbca030-4c7f-4e09-b2a6-d7e21c059430 req-6cfee1f3-8b45-4289-8f4b-4f7a8ff61d70 tempest-VolumesSnapshotsTestJSON-94770957 None] Created reservations ['a2f5c02c-32a6-4808-8239-1af0d65fb4de', 'b5524140-aa85-4095-87be-5d3df2a73a7d', 'ef2a9745-5b38-456e-b06e-b961004cbb9a', 'bb4e2a07-ed94-4951-a1cc-ea8b7a567ab8'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:59:07 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-2fbca030-4c7f-4e09-b2a6-d7e21c059430 req-6cfee1f3-8b45-4289-8f4b-4f7a8ff61d70 tempest-VolumesSnapshotsTestJSON-94770957 None] Delete snapshot completed successfully. Jul 07 21:59:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-2fbca030-4c7f-4e09-b2a6-d7e21c059430 req-6cfee1f3-8b45-4289-8f4b-4f7a8ff61d70 tempest-VolumesSnapshotsTestJSON-94770957 None] Lock "cinder-6ffb2d46-800d-40f3-b541-3d0a59bb17ed-delete_snapshot" released by "delete_snapshot" :: held 3.675s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:59:07 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:59:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Flow 'volume_create_manager' (a5d7c5df-ace1-468d-8675-23ae911bfc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:59:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe03b4f3-b1d5-4e10-9a45-d58cb5244691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe03b4f3-b1d5-4e10-9a45-d58cb5244691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-941108394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=078ce0c8-756e-4d56-a17f-ff9b9247b78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea28fe2347c49aab0a6aa2fcacaa3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:59:08Z,use_quota=True,user_id='e8e5bb96c1a24ab9acb899a80f3a0ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408b56fa-46ab-4059-8c53-8be4c7161d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408b56fa-46ab-4059-8c53-8be4c7161d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd389c0-a496-4d1f-ac84-ea558543e149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd389c0-a496-4d1f-ac84-ea558543e149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '078ce0c8-756e-4d56-a17f-ff9b9247b78e', 'volume_name': 'volume-078ce0c8-756e-4d56-a17f-ff9b9247b78e', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ce9675-7a85-49ba-998b-62e40de7162c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ce9675-7a85-49ba-998b-62e40de7162c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb74a26-d9bb-45a9-8b7b-7877db9bea04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:08 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Volume 078ce0c8-756e-4d56-a17f-ff9b9247b78e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-078ce0c8-756e-4d56-a17f-ff9b9247b78e', 'volume_size': 1} Jul 07 21:59:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-941108394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=078ce0c8-756e-4d56-a17f-ff9b9247b78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea28fe2347c49aab0a6aa2fcacaa3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:59:08Z,use_quota=True,user_id='e8e5bb96c1a24ab9acb899a80f3a0ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:59:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Creating volume 078ce0c8-756e-4d56-a17f-ff9b9247b78e {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:59:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:59:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:59:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:59:08 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:59:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-078ce0c8-756e-4d56-a17f-ff9b9247b78e 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:08 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-078ce0c8-756e-4d56-a17f-ff9b9247b78e 1073741824 Jul 07 21:59:08 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-5c0fa942-c9b5-4721-81cc-85f666f8bbc6 req-5694ac50-9b94-4013-bb59-567f3d14aaf1 tempest-VolumesSnapshotsTestJSON-94770957 None] Acquiring lock "cinder-f2bfa55b-e50c-4dd5-a7a5-448ff430d851-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:59:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-5c0fa942-c9b5-4721-81cc-85f666f8bbc6 req-5694ac50-9b94-4013-bb59-567f3d14aaf1 tempest-VolumesSnapshotsTestJSON-94770957 None] Lock "cinder-f2bfa55b-e50c-4dd5-a7a5-448ff430d851-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:59:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-5c0fa942-c9b5-4721-81cc-85f666f8bbc6 req-5694ac50-9b94-4013-bb59-567f3d14aaf1 tempest-VolumesSnapshotsTestJSON-94770957 None] Acquiring lock "cinder-quobyte-f2bfa55b-e50c-4dd5-a7a5-448ff430d851" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:59:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-5c0fa942-c9b5-4721-81cc-85f666f8bbc6 req-5694ac50-9b94-4013-bb59-567f3d14aaf1 tempest-VolumesSnapshotsTestJSON-94770957 None] Lock "cinder-quobyte-f2bfa55b-e50c-4dd5-a7a5-448ff430d851" acquired by "delete_volume" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:59:08 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1b0e22-68fa-4e36-ae29-0c29ef4de476]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:59:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-5c0fa942-c9b5-4721-81cc-85f666f8bbc6 req-5694ac50-9b94-4013-bb59-567f3d14aaf1 tempest-VolumesSnapshotsTestJSON-94770957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:08 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851 Jul 07 21:59:08 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:09 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-078ce0c8-756e-4d56-a17f-ff9b9247b78e 1073741824" returned: 0 in 1.210s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-078ce0c8-756e-4d56-a17f-ff9b9247b78e {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:09 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-078ce0c8-756e-4d56-a17f-ff9b9247b78e Jul 07 21:59:09 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-5c0fa942-c9b5-4721-81cc-85f666f8bbc6 req-5694ac50-9b94-4013-bb59-567f3d14aaf1 tempest-VolumesSnapshotsTestJSON-94770957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851" returned: 0 in 1.014s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:09 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-5c0fa942-c9b5-4721-81cc-85f666f8bbc6 req-5694ac50-9b94-4013-bb59-567f3d14aaf1 tempest-VolumesSnapshotsTestJSON-94770957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:09 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851 Jul 07 21:59:09 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:10 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-078ce0c8-756e-4d56-a17f-ff9b9247b78e" returned: 0 in 0.941s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] <== create_volume: return (2209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:59:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.214s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb74a26-d9bb-45a9-8b7b-7877db9bea04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-078ce0c8-756e-4d56-a17f-ff9b9247b78e', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a6bcc5-0854-40ae-b50f-621b257b1d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:10 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Volume volume-078ce0c8-756e-4d56-a17f-ff9b9247b78e (078ce0c8-756e-4d56-a17f-ff9b9247b78e): created successfully Jul 07 21:59:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a6bcc5-0854-40ae-b50f-621b257b1d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Flow 'volume_create_manager' (a5d7c5df-ace1-468d-8675-23ae911bfc3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:59:10 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6361b92a-f3b5-4a5b-b983-b524e1753390 tempest-VolumeQuotasAdminTestJSON-878041394 None] Created volume successfully. Jul 07 21:59:10 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-5c0fa942-c9b5-4721-81cc-85f666f8bbc6 req-5694ac50-9b94-4013-bb59-567f3d14aaf1 tempest-VolumesSnapshotsTestJSON-94770957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f2bfa55b-e50c-4dd5-a7a5-448ff430d851" returned: 0 in 0.887s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:10 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-5c0fa942-c9b5-4721-81cc-85f666f8bbc6 req-5694ac50-9b94-4013-bb59-567f3d14aaf1 tempest-VolumesSnapshotsTestJSON-94770957 None] Lock "cinder-quobyte-f2bfa55b-e50c-4dd5-a7a5-448ff430d851" released by "delete_volume" :: held 2.000s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:59:10 devstack cinder-volume[87586]: DEBUG cinder.quota [req-5c0fa942-c9b5-4721-81cc-85f666f8bbc6 req-5694ac50-9b94-4013-bb59-567f3d14aaf1 tempest-VolumesSnapshotsTestJSON-94770957 None] Created reservations ['bdf88422-50a5-44fd-9b9d-777259017596', '9f4b293d-d1d1-4a1d-a744-a14581e9dfb1', 'ee9adb2a-3247-4941-8427-7ab7aabea4c2', '026244f0-7d26-409f-82a5-b9dd74ac76a7'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:59:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-5c0fa942-c9b5-4721-81cc-85f666f8bbc6 req-5694ac50-9b94-4013-bb59-567f3d14aaf1 tempest-VolumesSnapshotsTestJSON-94770957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-5c0fa942-c9b5-4721-81cc-85f666f8bbc6 req-5694ac50-9b94-4013-bb59-567f3d14aaf1 tempest-VolumesSnapshotsTestJSON-94770957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [req-5c0fa942-c9b5-4721-81cc-85f666f8bbc6 req-5694ac50-9b94-4013-bb59-567f3d14aaf1 tempest-VolumesSnapshotsTestJSON-94770957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:59:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [req-5c0fa942-c9b5-4721-81cc-85f666f8bbc6 req-5694ac50-9b94-4013-bb59-567f3d14aaf1 tempest-VolumesSnapshotsTestJSON-94770957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:59:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-5c0fa942-c9b5-4721-81cc-85f666f8bbc6 req-5694ac50-9b94-4013-bb59-567f3d14aaf1 tempest-VolumesSnapshotsTestJSON-94770957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-5c0fa942-c9b5-4721-81cc-85f666f8bbc6 req-5694ac50-9b94-4013-bb59-567f3d14aaf1 tempest-VolumesSnapshotsTestJSON-94770957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:10 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:59:10 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e10ad55d-c231-44ac-831b-04f8e60868f8 tempest-VolumeQuotasAdminTestJSON-878041394 None] Acquiring lock "cinder-078ce0c8-756e-4d56-a17f-ff9b9247b78e-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:59:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e10ad55d-c231-44ac-831b-04f8e60868f8 tempest-VolumeQuotasAdminTestJSON-878041394 None] Lock "cinder-078ce0c8-756e-4d56-a17f-ff9b9247b78e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:59:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e10ad55d-c231-44ac-831b-04f8e60868f8 tempest-VolumeQuotasAdminTestJSON-878041394 None] Acquiring lock "cinder-quobyte-078ce0c8-756e-4d56-a17f-ff9b9247b78e" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:59:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e10ad55d-c231-44ac-831b-04f8e60868f8 tempest-VolumeQuotasAdminTestJSON-878041394 None] Lock "cinder-quobyte-078ce0c8-756e-4d56-a17f-ff9b9247b78e" acquired by "delete_volume" :: waited 0.044s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:59:11 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a67dff-0419-4eb9-8543-ccdcd2e4b482]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:59:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e10ad55d-c231-44ac-831b-04f8e60868f8 tempest-VolumeQuotasAdminTestJSON-878041394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-078ce0c8-756e-4d56-a17f-ff9b9247b78e {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:11 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-078ce0c8-756e-4d56-a17f-ff9b9247b78e Jul 07 21:59:11 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:11 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-5c0fa942-c9b5-4721-81cc-85f666f8bbc6 req-5694ac50-9b94-4013-bb59-567f3d14aaf1 tempest-VolumesSnapshotsTestJSON-94770957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.934s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:11 devstack cinder-volume[87586]: DEBUG cinder.manager [req-5c0fa942-c9b5-4721-81cc-85f666f8bbc6 req-5694ac50-9b94-4013-bb59-567f3d14aaf1 tempest-VolumesSnapshotsTestJSON-94770957 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:59:11 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-5c0fa942-c9b5-4721-81cc-85f666f8bbc6 req-5694ac50-9b94-4013-bb59-567f3d14aaf1 tempest-VolumesSnapshotsTestJSON-94770957 None] Deleted volume successfully. Jul 07 21:59:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-5c0fa942-c9b5-4721-81cc-85f666f8bbc6 req-5694ac50-9b94-4013-bb59-567f3d14aaf1 tempest-VolumesSnapshotsTestJSON-94770957 None] Lock "cinder-f2bfa55b-e50c-4dd5-a7a5-448ff430d851-delete_volume" released by "delete_volume" :: held 3.252s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:59:12 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e10ad55d-c231-44ac-831b-04f8e60868f8 tempest-VolumeQuotasAdminTestJSON-878041394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-078ce0c8-756e-4d56-a17f-ff9b9247b78e" returned: 0 in 0.968s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e10ad55d-c231-44ac-831b-04f8e60868f8 tempest-VolumeQuotasAdminTestJSON-878041394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-078ce0c8-756e-4d56-a17f-ff9b9247b78e {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:12 devstack sudo[95073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-078ce0c8-756e-4d56-a17f-ff9b9247b78e Jul 07 21:59:12 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:13 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e10ad55d-c231-44ac-831b-04f8e60868f8 tempest-VolumeQuotasAdminTestJSON-878041394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-078ce0c8-756e-4d56-a17f-ff9b9247b78e" returned: 0 in 0.725s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e10ad55d-c231-44ac-831b-04f8e60868f8 tempest-VolumeQuotasAdminTestJSON-878041394 None] Lock "cinder-quobyte-078ce0c8-756e-4d56-a17f-ff9b9247b78e" released by "delete_volume" :: held 1.761s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:59:13 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-e10ad55d-c231-44ac-831b-04f8e60868f8 tempest-VolumeQuotasAdminTestJSON-878041394 None] Created reservations ['250bbabe-b745-4304-902c-2c94cc9406ec', 'eae76f8c-12aa-4497-830d-0305270fb16e', 'fdcc627c-2018-4f34-9b19-e4bcdf2f9d69', 'a1ae05e8-2f18-4df5-8ee0-e5674b9ecbfa'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:59:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e10ad55d-c231-44ac-831b-04f8e60868f8 tempest-VolumeQuotasAdminTestJSON-878041394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e10ad55d-c231-44ac-831b-04f8e60868f8 tempest-VolumeQuotasAdminTestJSON-878041394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e10ad55d-c231-44ac-831b-04f8e60868f8 tempest-VolumeQuotasAdminTestJSON-878041394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:59:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e10ad55d-c231-44ac-831b-04f8e60868f8 tempest-VolumeQuotasAdminTestJSON-878041394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:59:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e10ad55d-c231-44ac-831b-04f8e60868f8 tempest-VolumeQuotasAdminTestJSON-878041394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e10ad55d-c231-44ac-831b-04f8e60868f8 tempest-VolumeQuotasAdminTestJSON-878041394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:13 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:59:13 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:14 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e10ad55d-c231-44ac-831b-04f8e60868f8 tempest-VolumeQuotasAdminTestJSON-878041394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.789s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-e10ad55d-c231-44ac-831b-04f8e60868f8 tempest-VolumeQuotasAdminTestJSON-878041394 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:59:14 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-e10ad55d-c231-44ac-831b-04f8e60868f8 tempest-VolumeQuotasAdminTestJSON-878041394 None] Deleted volume successfully. Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e10ad55d-c231-44ac-831b-04f8e60868f8 tempest-VolumeQuotasAdminTestJSON-878041394 None] Lock "cinder-078ce0c8-756e-4d56-a17f-ff9b9247b78e-delete_volume" released by "delete_volume" :: held 2.899s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Flow 'volume_create_manager' (ad6d68ea-2f5f-48bb-af6a-ade46af766e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649a8200-0155-490f-951b-9e540c3e2c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649a8200-0155-490f-951b-9e540c3e2c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1537469491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db62d37-4c6b-4c25-8c91-2cea2f9598d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea28fe2347c49aab0a6aa2fcacaa3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:59:14Z,use_quota=True,user_id='e8e5bb96c1a24ab9acb899a80f3a0ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b92d663-52a3-4f5c-bf93-69f99ff351ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b92d663-52a3-4f5c-bf93-69f99ff351ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea1edda-571b-440d-8519-972b97e072a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea1edda-571b-440d-8519-972b97e072a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5db62d37-4c6b-4c25-8c91-2cea2f9598d7', 'volume_name': 'volume-5db62d37-4c6b-4c25-8c91-2cea2f9598d7', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49986e0c-8dd3-4460-b277-41da8a5eaa2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49986e0c-8dd3-4460-b277-41da8a5eaa2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ea5789-8666-486f-b2ae-1ec47b7be216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:14 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Volume 5db62d37-4c6b-4c25-8c91-2cea2f9598d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5db62d37-4c6b-4c25-8c91-2cea2f9598d7', 'volume_size': 1} Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1537469491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db62d37-4c6b-4c25-8c91-2cea2f9598d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea28fe2347c49aab0a6aa2fcacaa3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:59:14Z,use_quota=True,user_id='e8e5bb96c1a24ab9acb899a80f3a0ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Creating volume 5db62d37-4c6b-4c25-8c91-2cea2f9598d7 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:59:14 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:59:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5db62d37-4c6b-4c25-8c91-2cea2f9598d7 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:14 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5db62d37-4c6b-4c25-8c91-2cea2f9598d7 1073741824 Jul 07 21:59:14 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:15 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5db62d37-4c6b-4c25-8c91-2cea2f9598d7 1073741824" returned: 0 in 0.991s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5db62d37-4c6b-4c25-8c91-2cea2f9598d7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:15 devstack sudo[95085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5db62d37-4c6b-4c25-8c91-2cea2f9598d7 Jul 07 21:59:15 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:16 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5db62d37-4c6b-4c25-8c91-2cea2f9598d7" returned: 0 in 1.063s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] <== create_volume: return (2112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:59:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.115s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ea5789-8666-486f-b2ae-1ec47b7be216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5db62d37-4c6b-4c25-8c91-2cea2f9598d7', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f045adb9-a293-4158-97ca-9f861affe671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:16 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Volume volume-5db62d37-4c6b-4c25-8c91-2cea2f9598d7 (5db62d37-4c6b-4c25-8c91-2cea2f9598d7): created successfully Jul 07 21:59:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f045adb9-a293-4158-97ca-9f861affe671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Flow 'volume_create_manager' (ad6d68ea-2f5f-48bb-af6a-ade46af766e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:59:16 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-8bc76a5a-7808-4222-9dc0-9d444a1e5953 tempest-VolumeQuotasAdminTestJSON-878041394 None] Created volume successfully. Jul 07 21:59:18 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-bc2bd651-b14f-43bc-9908-8a240a38559a tempest-VolumeQuotasAdminTestJSON-1161266391 None] Transfer volume completed successfully. Jul 07 21:59:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-36c79593-e333-47ff-b8d8-7c3f7f4b6ff4 tempest-VolumeQuotasAdminTestJSON-813551457 None] Acquiring lock "cinder-5db62d37-4c6b-4c25-8c91-2cea2f9598d7-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:59:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-36c79593-e333-47ff-b8d8-7c3f7f4b6ff4 tempest-VolumeQuotasAdminTestJSON-813551457 None] Lock "cinder-5db62d37-4c6b-4c25-8c91-2cea2f9598d7-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:59:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-36c79593-e333-47ff-b8d8-7c3f7f4b6ff4 tempest-VolumeQuotasAdminTestJSON-813551457 None] Acquiring lock "cinder-quobyte-5db62d37-4c6b-4c25-8c91-2cea2f9598d7" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:59:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-36c79593-e333-47ff-b8d8-7c3f7f4b6ff4 tempest-VolumeQuotasAdminTestJSON-813551457 None] Lock "cinder-quobyte-5db62d37-4c6b-4c25-8c91-2cea2f9598d7" acquired by "delete_volume" :: waited 0.032s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:59:19 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e26425-8294-4d98-bfd9-e627c57f8ef3]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:59:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-36c79593-e333-47ff-b8d8-7c3f7f4b6ff4 tempest-VolumeQuotasAdminTestJSON-813551457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5db62d37-4c6b-4c25-8c91-2cea2f9598d7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:20 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5db62d37-4c6b-4c25-8c91-2cea2f9598d7 Jul 07 21:59:20 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:21 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-36c79593-e333-47ff-b8d8-7c3f7f4b6ff4 tempest-VolumeQuotasAdminTestJSON-813551457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5db62d37-4c6b-4c25-8c91-2cea2f9598d7" returned: 0 in 1.510s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-36c79593-e333-47ff-b8d8-7c3f7f4b6ff4 tempest-VolumeQuotasAdminTestJSON-813551457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5db62d37-4c6b-4c25-8c91-2cea2f9598d7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:21 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5db62d37-4c6b-4c25-8c91-2cea2f9598d7 Jul 07 21:59:21 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:22 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-36c79593-e333-47ff-b8d8-7c3f7f4b6ff4 tempest-VolumeQuotasAdminTestJSON-813551457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5db62d37-4c6b-4c25-8c91-2cea2f9598d7" returned: 0 in 1.015s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-36c79593-e333-47ff-b8d8-7c3f7f4b6ff4 tempest-VolumeQuotasAdminTestJSON-813551457 None] Lock "cinder-quobyte-5db62d37-4c6b-4c25-8c91-2cea2f9598d7" released by "delete_volume" :: held 2.636s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:59:22 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-36c79593-e333-47ff-b8d8-7c3f7f4b6ff4 tempest-VolumeQuotasAdminTestJSON-813551457 None] Created reservations ['b01431d8-a325-4771-a9c9-66d317a9b586', 'cea1746e-d3eb-4e19-b8bb-4737fda17f3f', 'af900aa8-10a7-4162-a756-4a82d3be905f', '363c6f78-9e3c-46b4-8e2e-99211dc3ed65'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:59:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-36c79593-e333-47ff-b8d8-7c3f7f4b6ff4 tempest-VolumeQuotasAdminTestJSON-813551457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-36c79593-e333-47ff-b8d8-7c3f7f4b6ff4 tempest-VolumeQuotasAdminTestJSON-813551457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-36c79593-e333-47ff-b8d8-7c3f7f4b6ff4 tempest-VolumeQuotasAdminTestJSON-813551457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:59:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-36c79593-e333-47ff-b8d8-7c3f7f4b6ff4 tempest-VolumeQuotasAdminTestJSON-813551457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:59:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-36c79593-e333-47ff-b8d8-7c3f7f4b6ff4 tempest-VolumeQuotasAdminTestJSON-813551457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-36c79593-e333-47ff-b8d8-7c3f7f4b6ff4 tempest-VolumeQuotasAdminTestJSON-813551457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:22 devstack sudo[95182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:59:22 devstack sudo[95182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:23 devstack sudo[95182]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-36c79593-e333-47ff-b8d8-7c3f7f4b6ff4 tempest-VolumeQuotasAdminTestJSON-813551457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.980s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:23 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-36c79593-e333-47ff-b8d8-7c3f7f4b6ff4 tempest-VolumeQuotasAdminTestJSON-813551457 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:59:23 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-36c79593-e333-47ff-b8d8-7c3f7f4b6ff4 tempest-VolumeQuotasAdminTestJSON-813551457 None] Deleted volume successfully. Jul 07 21:59:23 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-36c79593-e333-47ff-b8d8-7c3f7f4b6ff4 tempest-VolumeQuotasAdminTestJSON-813551457 None] Lock "cinder-5db62d37-4c6b-4c25-8c91-2cea2f9598d7-delete_volume" released by "delete_volume" :: held 4.096s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:59:24 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-26f0f222-4b44-4c67-a49f-19453bbf7280 tempest-GroupSnapshotsV319Test-341748200 None] Group tempest-GroupSnapshotsV319Test-Group-186898959: creating Jul 07 21:59:24 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-26f0f222-4b44-4c67-a49f-19453bbf7280 tempest-GroupSnapshotsV319Test-341748200 None] Group tempest-GroupSnapshotsV319Test-Group-186898959: created successfully Jul 07 21:59:24 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-26f0f222-4b44-4c67-a49f-19453bbf7280 tempest-GroupSnapshotsV319Test-341748200 None] Create group completed successfully. Jul 07 21:59:26 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:59:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Flow 'volume_create_manager' (246591ae-f03b-44e6-8f61-7a357731e44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:59:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d89cdb2-8e0d-4979-a218-c3deecf97109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d89cdb2-8e0d-4979-a218-c3deecf97109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-113740083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=797b4b4f-471a-4afa-9ee0-5cce37c8e0b3,host='devstack@QuobyteHD#QuobyteHD',id=36e402ce-9573-4c0b-8ac2-b2105a40a38f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f388e0e4f445e18f22654d10f2905b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:59:26Z,use_quota=True,user_id='1db19677594444eb883a4fcb28431980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81e8566a-6617-4286-a21f-93d0e6aac5a9),volume_type_id=81e8566a-6617-4286-a21f-93d0e6aac5a9)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87130802-b529-46ce-90a2-07d198020c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87130802-b529-46ce-90a2-07d198020c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b8409b-c9f0-4f39-86b1-a5a05233d406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b8409b-c9f0-4f39-86b1-a5a05233d406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36e402ce-9573-4c0b-8ac2-b2105a40a38f', 'volume_name': 'volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb257b5-c393-4d5b-9085-fa62a22a94fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb257b5-c393-4d5b-9085-fa62a22a94fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3072bdde-930d-42b8-b05a-7dc7d67c8b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:26 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Volume 36e402ce-9573-4c0b-8ac2-b2105a40a38f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f', 'volume_size': 1} Jul 07 21:59:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=797b4b4f-471a-4afa-9ee0-5cce37c8e0b3,created_at=2026-07-07T19:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-113740083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=797b4b4f-471a-4afa-9ee0-5cce37c8e0b3,host='devstack@QuobyteHD#QuobyteHD',id=36e402ce-9573-4c0b-8ac2-b2105a40a38f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15f388e0e4f445e18f22654d10f2905b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:59:26Z,use_quota=True,user_id='1db19677594444eb883a4fcb28431980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81e8566a-6617-4286-a21f-93d0e6aac5a9),volume_type_id=81e8566a-6617-4286-a21f-93d0e6aac5a9)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:59:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Creating volume 36e402ce-9573-4c0b-8ac2-b2105a40a38f {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:59:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:59:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:59:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:59:26 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:59:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:26 devstack sudo[95186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f 1073741824 Jul 07 21:59:26 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:27 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f 1073741824" returned: 0 in 1.263s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:27 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f Jul 07 21:59:27 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:28 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f" returned: 0 in 0.864s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] <== create_volume: return (2179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:59:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.184s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3072bdde-930d-42b8-b05a-7dc7d67c8b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dca6d74-1236-4288-adc8-88208aeb012a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:28 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Volume volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f (36e402ce-9573-4c0b-8ac2-b2105a40a38f): created successfully Jul 07 21:59:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dca6d74-1236-4288-adc8-88208aeb012a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Flow 'volume_create_manager' (246591ae-f03b-44e6-8f61-7a357731e44a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:59:28 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-886cb4c5-f42d-4616-af05-c2fb95f1af24 tempest-GroupSnapshotsV319Test-341748200 None] Created volume successfully. Jul 07 21:59:30 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-b5dde52a-d89c-48cf-abad-640c62c2eda9 tempest-GroupSnapshotsV319Test-341748200 None] GroupSnapshot 2416682c-4919-47e8-9c09-f1e6869fa603: creating. Jul 07 21:59:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b5dde52a-d89c-48cf-abad-640c62c2eda9 tempest-GroupSnapshotsV319Test-341748200 None] Group snapshot 2416682c-4919-47e8-9c09-f1e6869fa603: creating. {{(pid=87586) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4181}} Jul 07 21:59:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b5dde52a-d89c-48cf-abad-640c62c2eda9 tempest-GroupSnapshotsV319Test-341748200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b5dde52a-d89c-48cf-abad-640c62c2eda9 tempest-GroupSnapshotsV319Test-341748200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-b5dde52a-d89c-48cf-abad-640c62c2eda9 tempest-GroupSnapshotsV319Test-341748200 None] Creating offline snapshot 0b205698-2bcc-4154-8396-64c8627bdf3c of volume 36e402ce-9573-4c0b-8ac2-b2105a40a38f {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 21:59:30 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d2e875-3a63-4c8c-9500-715d51f7340a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:59:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b5dde52a-d89c-48cf-abad-640c62c2eda9 tempest-GroupSnapshotsV319Test-341748200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:31 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f Jul 07 21:59:31 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:32 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b5dde52a-d89c-48cf-abad-640c62c2eda9 tempest-GroupSnapshotsV319Test-341748200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f" returned: 0 in 1.066s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b5dde52a-d89c-48cf-abad-640c62c2eda9 tempest-GroupSnapshotsV319Test-341748200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.0b205698-2bcc-4154-8396-64c8627bdf3c 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:32 devstack sudo[95270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.0b205698-2bcc-4154-8396-64c8627bdf3c 1G Jul 07 21:59:32 devstack sudo[95270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:32 devstack sudo[95270]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b5dde52a-d89c-48cf-abad-640c62c2eda9 tempest-GroupSnapshotsV319Test-341748200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.0b205698-2bcc-4154-8396-64c8627bdf3c 1G" returned: 0 in 0.940s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b5dde52a-d89c-48cf-abad-640c62c2eda9 tempest-GroupSnapshotsV319Test-341748200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.0b205698-2bcc-4154-8396-64c8627bdf3c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:32 devstack sudo[95276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.0b205698-2bcc-4154-8396-64c8627bdf3c Jul 07 21:59:32 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Flow 'volume_create_manager' (1ba0bfc3-38dd-436f-9c0c-e894a3a55e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a657f6c-3079-47a3-9102-947c8d30699a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a657f6c-3079-47a3-9102-947c8d30699a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-716614476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14614cbd-55c4-4bc7-a851-1debd8119ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371db66932a54b8089f75311808f045e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:59:33Z,use_quota=True,user_id='480b313afaa64001a9f6aac307acf81a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8faed4a3-9f42-4399-8f99-c6b1e2aca1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8faed4a3-9f42-4399-8f99-c6b1e2aca1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3fc20c2-bd39-4833-af09-c254d829e348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3fc20c2-bd39-4833-af09-c254d829e348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14614cbd-55c4-4bc7-a851-1debd8119ead', 'volume_name': 'volume-14614cbd-55c4-4bc7-a851-1debd8119ead', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31114fc2-6678-41ed-80c1-d1a718232ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31114fc2-6678-41ed-80c1-d1a718232ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fd77bb-cad5-4862-9c35-e85d41b0aa18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:33 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Volume 14614cbd-55c4-4bc7-a851-1debd8119ead: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14614cbd-55c4-4bc7-a851-1debd8119ead', 'volume_size': 1} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Flow 'volume_create_manager' (cca9cbe6-7a90-4897-9efb-8465f47d99eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bded3e38-7dde-4624-85ab-6a643e153553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bded3e38-7dde-4624-85ab-6a643e153553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-614747230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e663f4c-611f-4552-a312-63a4f2c4167f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a35dd5b7aeb46c491d62a83cd4aa445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:59:34Z,use_quota=True,user_id='45564201eb9a4d8aa38dd3fcf9b744a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6189a01-61e7-4fe5-b1c0-1cf3235ad925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6189a01-61e7-4fe5-b1c0-1cf3235ad925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4f518a-5899-4209-91f4-1cca1bd22a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4f518a-5899-4209-91f4-1cca1bd22a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e663f4c-611f-4552-a312-63a4f2c4167f', 'volume_name': 'volume-0e663f4c-611f-4552-a312-63a4f2c4167f', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6dfffec-1462-4f79-a9cb-38e6c2fe6677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6dfffec-1462-4f79-a9cb-38e6c2fe6677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:33 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d94e0d-84b0-44ea-b249-145bf857c363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:33 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Volume 0e663f4c-611f-4552-a312-63a4f2c4167f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e663f4c-611f-4552-a312-63a4f2c4167f', 'volume_size': 1} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b5dde52a-d89c-48cf-abad-640c62c2eda9 tempest-GroupSnapshotsV319Test-341748200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.0b205698-2bcc-4154-8396-64c8627bdf3c" returned: 0 in 0.752s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:33 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-b5dde52a-d89c-48cf-abad-640c62c2eda9 tempest-GroupSnapshotsV319Test-341748200 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.0b205698-2bcc-4154-8396-64c8627bdf3c is being set with open permissions: ugo+rw: NotImplementedError Jul 07 21:59:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b5dde52a-d89c-48cf-abad-640c62c2eda9 tempest-GroupSnapshotsV319Test-341748200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.0b205698-2bcc-4154-8396-64c8627bdf3c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:33 devstack sudo[95282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.0b205698-2bcc-4154-8396-64c8627bdf3c Jul 07 21:59:33 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:34 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b5dde52a-d89c-48cf-abad-640c62c2eda9 tempest-GroupSnapshotsV319Test-341748200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.0b205698-2bcc-4154-8396-64c8627bdf3c" returned: 0 in 0.602s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b5dde52a-d89c-48cf-abad-640c62c2eda9 tempest-GroupSnapshotsV319Test-341748200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:34 devstack sudo[95285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.info Jul 07 21:59:34 devstack sudo[95285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:34 devstack sudo[95285]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b5dde52a-d89c-48cf-abad-640c62c2eda9 tempest-GroupSnapshotsV319Test-341748200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.info" returned: 0 in 0.616s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:34 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-b5dde52a-d89c-48cf-abad-640c62c2eda9 tempest-GroupSnapshotsV319Test-341748200 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 21:59:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b5dde52a-d89c-48cf-abad-640c62c2eda9 tempest-GroupSnapshotsV319Test-341748200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:34 devstack sudo[95288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.info Jul 07 21:59:34 devstack sudo[95288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:59:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:59:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:59:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:35 devstack sudo[95288]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b5dde52a-d89c-48cf-abad-640c62c2eda9 tempest-GroupSnapshotsV319Test-341748200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.info" returned: 0 in 0.595s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:35 devstack sudo[95291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:59:35 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b5dde52a-d89c-48cf-abad-640c62c2eda9 tempest-GroupSnapshotsV319Test-341748200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.666s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.104s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-716614476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14614cbd-55c4-4bc7-a851-1debd8119ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371db66932a54b8089f75311808f045e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:59:33Z,use_quota=True,user_id='480b313afaa64001a9f6aac307acf81a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:59:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Creating volume 14614cbd-55c4-4bc7-a851-1debd8119ead {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:59:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:59:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:59:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:59:35 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:59:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-14614cbd-55c4-4bc7-a851-1debd8119ead 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:35 devstack sudo[95293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-14614cbd-55c4-4bc7-a851-1debd8119ead 1073741824 Jul 07 21:59:35 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:35 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-b5dde52a-d89c-48cf-abad-640c62c2eda9 tempest-GroupSnapshotsV319Test-341748200 None] group_snapshot 2416682c-4919-47e8-9c09-f1e6869fa603: created successfully Jul 07 21:59:36 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.618s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:59:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 21:59:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 8 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 21:59:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 21:59:36 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-14614cbd-55c4-4bc7-a851-1debd8119ead 1073741824" returned: 0 in 0.909s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-14614cbd-55c4-4bc7-a851-1debd8119ead {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:36 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-14614cbd-55c4-4bc7-a851-1debd8119ead Jul 07 21:59:36 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:36 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] group_snapshot 2416682c-4919-47e8-9c09-f1e6869fa603: deleting Jul 07 21:59:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] group_snapshot 2416682c-4919-47e8-9c09-f1e6869fa603: deleting {{(pid=87586) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4356}} Jul 07 21:59:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] Acquiring lock "cinder-quobyte-36e402ce-9573-4c0b-8ac2-b2105a40a38f" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:59:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] Lock "cinder-quobyte-36e402ce-9573-4c0b-8ac2-b2105a40a38f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:59:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] Acquiring lock "cinder-quobyte-0b205698-2bcc-4154-8396-64c8627bdf3c" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:59:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] Lock "cinder-quobyte-0b205698-2bcc-4154-8396-64c8627bdf3c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:59:36 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] Deleting offline snapshot 0b205698-2bcc-4154-8396-64c8627bdf3c of volume 36e402ce-9573-4c0b-8ac2-b2105a40a38f {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 21:59:36 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] snapshot_file for this snap is: volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.0b205698-2bcc-4154-8396-64c8627bdf3c {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 21:59:36 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[334c6f3b-bbe7-4092-9b61-448daea18739]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:59:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.0b205698-2bcc-4154-8396-64c8627bdf3c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:36 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.0b205698-2bcc-4154-8396-64c8627bdf3c Jul 07 21:59:36 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:37 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-14614cbd-55c4-4bc7-a851-1debd8119ead" returned: 0 in 0.664s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.498s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-614747230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e663f4c-611f-4552-a312-63a4f2c4167f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a35dd5b7aeb46c491d62a83cd4aa445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:59:34Z,use_quota=True,user_id='45564201eb9a4d8aa38dd3fcf9b744a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Creating volume 0e663f4c-611f-4552-a312-63a4f2c4167f {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:59:37 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0e663f4c-611f-4552-a312-63a4f2c4167f 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9fd77bb-cad5-4862-9c35-e85d41b0aa18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14614cbd-55c4-4bc7-a851-1debd8119ead', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:37 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0e663f4c-611f-4552-a312-63a4f2c4167f 1073741824 Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d9e990-2351-44c2-a28e-aa4cd2ccc993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:37 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:37 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Volume volume-14614cbd-55c4-4bc7-a851-1debd8119ead (14614cbd-55c4-4bc7-a851-1debd8119ead): created successfully Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d9e990-2351-44c2-a28e-aa4cd2ccc993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Flow 'volume_create_manager' (1ba0bfc3-38dd-436f-9c0c-e894a3a55e56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:59:37 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-183cedbe-3fcf-44f7-aafb-f75388ac8d6e tempest-AbsoluteLimitsTests-715739119 None] Created volume successfully. Jul 07 21:59:37 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.0b205698-2bcc-4154-8396-64c8627bdf3c" returned: 0 in 0.816s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-102fe28e-0c93-4fff-96a4-6e047b30c46c tempest-AbsoluteLimitsTests-715739119 None] Acquiring lock "cinder-14614cbd-55c4-4bc7-a851-1debd8119ead-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e52752c-ac60-4cb9-bfec-ec9a03205f82]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-102fe28e-0c93-4fff-96a4-6e047b30c46c tempest-AbsoluteLimitsTests-715739119 None] Lock "cinder-14614cbd-55c4-4bc7-a851-1debd8119ead-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-102fe28e-0c93-4fff-96a4-6e047b30c46c tempest-AbsoluteLimitsTests-715739119 None] Acquiring lock "cinder-quobyte-14614cbd-55c4-4bc7-a851-1debd8119ead" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-102fe28e-0c93-4fff-96a4-6e047b30c46c tempest-AbsoluteLimitsTests-715739119 None] Lock "cinder-quobyte-14614cbd-55c4-4bc7-a851-1debd8119ead" acquired by "delete_volume" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf655877-3e12-48c1-af6f-81644261631b]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:59:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-102fe28e-0c93-4fff-96a4-6e047b30c46c tempest-AbsoluteLimitsTests-715739119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-14614cbd-55c4-4bc7-a851-1debd8119ead {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:37 devstack sudo[95310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f Jul 07 21:59:37 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:37 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-14614cbd-55c4-4bc7-a851-1debd8119ead Jul 07 21:59:38 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:38 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0e663f4c-611f-4552-a312-63a4f2c4167f 1073741824" returned: 0 in 0.991s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0e663f4c-611f-4552-a312-63a4f2c4167f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:38 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0e663f4c-611f-4552-a312-63a4f2c4167f Jul 07 21:59:38 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:38 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f" returned: 0 in 0.949s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.0b205698-2bcc-4154-8396-64c8627bdf3c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:38 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.0b205698-2bcc-4154-8396-64c8627bdf3c Jul 07 21:59:38 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:38 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-102fe28e-0c93-4fff-96a4-6e047b30c46c tempest-AbsoluteLimitsTests-715739119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-14614cbd-55c4-4bc7-a851-1debd8119ead" returned: 0 in 0.940s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-102fe28e-0c93-4fff-96a4-6e047b30c46c tempest-AbsoluteLimitsTests-715739119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-14614cbd-55c4-4bc7-a851-1debd8119ead {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:38 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-14614cbd-55c4-4bc7-a851-1debd8119ead Jul 07 21:59:38 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:38 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0e663f4c-611f-4552-a312-63a4f2c4167f" returned: 0 in 0.736s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:39 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:59:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3d94e0d-84b0-44ea-b249-145bf857c363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e663f4c-611f-4552-a312-63a4f2c4167f', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026935d6-a3db-4bf2-bea6-18f0fc4a2fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:39 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Volume volume-0e663f4c-611f-4552-a312-63a4f2c4167f (0e663f4c-611f-4552-a312-63a4f2c4167f): created successfully Jul 07 21:59:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026935d6-a3db-4bf2-bea6-18f0fc4a2fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Flow 'volume_create_manager' (cca9cbe6-7a90-4897-9efb-8465f47d99eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:59:39 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-bfb38661-a31d-4239-b24e-1a63529661a1 tempest-VolumesServicesTestJSON-2054927148 None] Created volume successfully. Jul 07 21:59:39 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.0b205698-2bcc-4154-8396-64c8627bdf3c" returned: 0 in 0.798s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.0b205698-2bcc-4154-8396-64c8627bdf3c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:39 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.0b205698-2bcc-4154-8396-64c8627bdf3c Jul 07 21:59:39 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:39 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-102fe28e-0c93-4fff-96a4-6e047b30c46c tempest-AbsoluteLimitsTests-715739119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-14614cbd-55c4-4bc7-a851-1debd8119ead" returned: 0 in 0.711s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-102fe28e-0c93-4fff-96a4-6e047b30c46c tempest-AbsoluteLimitsTests-715739119 None] Lock "cinder-quobyte-14614cbd-55c4-4bc7-a851-1debd8119ead" released by "delete_volume" :: held 1.706s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:59:39 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-102fe28e-0c93-4fff-96a4-6e047b30c46c tempest-AbsoluteLimitsTests-715739119 None] Created reservations ['5578062d-e7dc-4de2-81b9-013d1ee45464', '39ebd5cf-69d9-4bcc-a378-a0f5afbc7f83', '49925e47-fc61-4f48-ba3a-a7662b578ced', '61b3051f-9e61-483e-a090-ecf530878b84'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:59:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-102fe28e-0c93-4fff-96a4-6e047b30c46c tempest-AbsoluteLimitsTests-715739119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-102fe28e-0c93-4fff-96a4-6e047b30c46c tempest-AbsoluteLimitsTests-715739119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:39 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-102fe28e-0c93-4fff-96a4-6e047b30c46c tempest-AbsoluteLimitsTests-715739119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:59:39 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-102fe28e-0c93-4fff-96a4-6e047b30c46c tempest-AbsoluteLimitsTests-715739119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:59:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-102fe28e-0c93-4fff-96a4-6e047b30c46c tempest-AbsoluteLimitsTests-715739119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-102fe28e-0c93-4fff-96a4-6e047b30c46c tempest-AbsoluteLimitsTests-715739119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:39 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:59:39 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:40 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f.0b205698-2bcc-4154-8396-64c8627bdf3c" returned: 0 in 0.839s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:40 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-102fe28e-0c93-4fff-96a4-6e047b30c46c tempest-AbsoluteLimitsTests-715739119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.685s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:40 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-102fe28e-0c93-4fff-96a4-6e047b30c46c tempest-AbsoluteLimitsTests-715739119 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:59:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] Lock "cinder-quobyte-0b205698-2bcc-4154-8396-64c8627bdf3c" released by "_delete_snapshot" :: held 3.530s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:59:40 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-102fe28e-0c93-4fff-96a4-6e047b30c46c tempest-AbsoluteLimitsTests-715739119 None] Deleted volume successfully. Jul 07 21:59:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] Lock "cinder-quobyte-36e402ce-9573-4c0b-8ac2-b2105a40a38f" released by "delete_snapshot" :: held 3.556s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:59:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d4d6bb7a-46a4-4f1a-a00f-01178f83a5a3 tempest-VolumesServicesTestJSON-2054927148 None] Acquiring lock "cinder-0e663f4c-611f-4552-a312-63a4f2c4167f-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:59:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-102fe28e-0c93-4fff-96a4-6e047b30c46c tempest-AbsoluteLimitsTests-715739119 None] Lock "cinder-14614cbd-55c4-4bc7-a851-1debd8119ead-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:59:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d4d6bb7a-46a4-4f1a-a00f-01178f83a5a3 tempest-VolumesServicesTestJSON-2054927148 None] Lock "cinder-0e663f4c-611f-4552-a312-63a4f2c4167f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:59:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d4d6bb7a-46a4-4f1a-a00f-01178f83a5a3 tempest-VolumesServicesTestJSON-2054927148 None] Acquiring lock "cinder-quobyte-0e663f4c-611f-4552-a312-63a4f2c4167f" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:59:40 devstack cinder-volume[87586]: WARNING cinder.quota [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-252014697 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-252014697, it is now deprecated. Please use the default quota class for default quota. Jul 07 21:59:40 devstack cinder-volume[87586]: WARNING cinder.quota [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-252014697 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-252014697, it is now deprecated. Please use the default quota class for default quota. Jul 07 21:59:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d4d6bb7a-46a4-4f1a-a00f-01178f83a5a3 tempest-VolumesServicesTestJSON-2054927148 None] Lock "cinder-quobyte-0e663f4c-611f-4552-a312-63a4f2c4167f" acquired by "delete_volume" :: waited 0.055s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:59:40 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] Created reservations ['be8ef49b-4f9c-40c8-b930-749fdec484ef', '03003ab0-4f64-4182-8ca7-0f034d31f9e1', '5f9bbcd7-30bf-46cb-a757-2a15f99f86fd', '6dcb0836-c013-4619-b1b1-a0dd129c1c66'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:59:40 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d82606f-04e5-47c6-889f-aefbf32938d7]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:59:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d4d6bb7a-46a4-4f1a-a00f-01178f83a5a3 tempest-VolumesServicesTestJSON-2054927148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0e663f4c-611f-4552-a312-63a4f2c4167f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:40 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-c15cc28f-1aa2-4013-94e6-672756729e12 tempest-GroupSnapshotsV319Test-341748200 None] group_snapshot 2416682c-4919-47e8-9c09-f1e6869fa603: deleted successfully Jul 07 21:59:40 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0e663f4c-611f-4552-a312-63a4f2c4167f Jul 07 21:59:40 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:41 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d4d6bb7a-46a4-4f1a-a00f-01178f83a5a3 tempest-VolumesServicesTestJSON-2054927148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0e663f4c-611f-4552-a312-63a4f2c4167f" returned: 0 in 0.857s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d4d6bb7a-46a4-4f1a-a00f-01178f83a5a3 tempest-VolumesServicesTestJSON-2054927148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0e663f4c-611f-4552-a312-63a4f2c4167f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:41 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0e663f4c-611f-4552-a312-63a4f2c4167f Jul 07 21:59:41 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:41 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d02bab94-817d-46ed-8e1f-dcabb103ef71 tempest-GroupSnapshotsV319Test-341748200 None] Acquiring lock "cinder-quobyte-36e402ce-9573-4c0b-8ac2-b2105a40a38f" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:59:41 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d02bab94-817d-46ed-8e1f-dcabb103ef71 tempest-GroupSnapshotsV319Test-341748200 None] Lock "cinder-quobyte-36e402ce-9573-4c0b-8ac2-b2105a40a38f" acquired by "delete_volume" :: waited 0.022s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:59:41 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5eaf20-536d-45c2-bddb-c999c1b2b0c2]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:59:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d02bab94-817d-46ed-8e1f-dcabb103ef71 tempest-GroupSnapshotsV319Test-341748200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:41 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f Jul 07 21:59:41 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:42 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d4d6bb7a-46a4-4f1a-a00f-01178f83a5a3 tempest-VolumesServicesTestJSON-2054927148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0e663f4c-611f-4552-a312-63a4f2c4167f" returned: 0 in 0.749s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d4d6bb7a-46a4-4f1a-a00f-01178f83a5a3 tempest-VolumesServicesTestJSON-2054927148 None] Lock "cinder-quobyte-0e663f4c-611f-4552-a312-63a4f2c4167f" released by "delete_volume" :: held 1.657s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:59:42 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-d4d6bb7a-46a4-4f1a-a00f-01178f83a5a3 tempest-VolumesServicesTestJSON-2054927148 None] Created reservations ['cf5523e5-e633-44b0-8256-5efe67411a8d', 'aabf34e9-4474-42b6-b18e-b0951da52b6f', 'bf57345b-a325-4929-bf8f-15278d46ded4', '5bb7a4ce-6e4c-4f82-a3ef-12bfb7926282'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:59:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d4d6bb7a-46a4-4f1a-a00f-01178f83a5a3 tempest-VolumesServicesTestJSON-2054927148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d4d6bb7a-46a4-4f1a-a00f-01178f83a5a3 tempest-VolumesServicesTestJSON-2054927148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d4d6bb7a-46a4-4f1a-a00f-01178f83a5a3 tempest-VolumesServicesTestJSON-2054927148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:59:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d4d6bb7a-46a4-4f1a-a00f-01178f83a5a3 tempest-VolumesServicesTestJSON-2054927148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:59:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d4d6bb7a-46a4-4f1a-a00f-01178f83a5a3 tempest-VolumesServicesTestJSON-2054927148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d4d6bb7a-46a4-4f1a-a00f-01178f83a5a3 tempest-VolumesServicesTestJSON-2054927148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:42 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:59:42 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:42 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d02bab94-817d-46ed-8e1f-dcabb103ef71 tempest-GroupSnapshotsV319Test-341748200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f" returned: 0 in 0.891s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d02bab94-817d-46ed-8e1f-dcabb103ef71 tempest-GroupSnapshotsV319Test-341748200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:42 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f Jul 07 21:59:42 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:43 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d02bab94-817d-46ed-8e1f-dcabb103ef71 tempest-GroupSnapshotsV319Test-341748200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-36e402ce-9573-4c0b-8ac2-b2105a40a38f" returned: 0 in 0.885s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d02bab94-817d-46ed-8e1f-dcabb103ef71 tempest-GroupSnapshotsV319Test-341748200 None] Lock "cinder-quobyte-36e402ce-9573-4c0b-8ac2-b2105a40a38f" released by "delete_volume" :: held 1.881s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:59:43 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d4d6bb7a-46a4-4f1a-a00f-01178f83a5a3 tempest-VolumesServicesTestJSON-2054927148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.112s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-d4d6bb7a-46a4-4f1a-a00f-01178f83a5a3 tempest-VolumesServicesTestJSON-2054927148 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:59:43 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d4d6bb7a-46a4-4f1a-a00f-01178f83a5a3 tempest-VolumesServicesTestJSON-2054927148 None] Deleted volume successfully. Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d4d6bb7a-46a4-4f1a-a00f-01178f83a5a3 tempest-VolumesServicesTestJSON-2054927148 None] Lock "cinder-0e663f4c-611f-4552-a312-63a4f2c4167f-delete_volume" released by "delete_volume" :: held 3.101s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-d02bab94-817d-46ed-8e1f-dcabb103ef71 tempest-GroupSnapshotsV319Test-341748200 None] Created reservations ['33708bbc-ea5d-4053-93eb-882769fc073d'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:59:43 devstack cinder-volume[87586]: WARNING cinder.quota [None req-d02bab94-817d-46ed-8e1f-dcabb103ef71 tempest-GroupSnapshotsV319Test-341748200 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-252014697 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-252014697, it is now deprecated. Please use the default quota class for default quota. Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-d02bab94-817d-46ed-8e1f-dcabb103ef71 tempest-GroupSnapshotsV319Test-341748200 None] Created reservations ['d7d4769f-4e47-4848-b0f0-b616ec7db038', '6813394e-2cf3-45c5-be40-713775da9611', 'd801922d-98d9-4d44-9570-877d49a5cb2b', '22d79204-cc21-498a-9ef3-19255a193bf3'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Flow 'volume_create_manager' (02361783-feba-44ff-a913-a0c94ce020e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bec29e5-64d4-40d7-b343-ef365e7cf3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d02bab94-817d-46ed-8e1f-dcabb103ef71 tempest-GroupSnapshotsV319Test-341748200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d02bab94-817d-46ed-8e1f-dcabb103ef71 tempest-GroupSnapshotsV319Test-341748200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d02bab94-817d-46ed-8e1f-dcabb103ef71 tempest-GroupSnapshotsV319Test-341748200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d02bab94-817d-46ed-8e1f-dcabb103ef71 tempest-GroupSnapshotsV319Test-341748200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d02bab94-817d-46ed-8e1f-dcabb103ef71 tempest-GroupSnapshotsV319Test-341748200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d02bab94-817d-46ed-8e1f-dcabb103ef71 tempest-GroupSnapshotsV319Test-341748200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:43 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:59:43 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bec29e5-64d4-40d7-b343-ef365e7cf3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2013134581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8167e04c-2e5d-4900-a26b-0464e0004a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0cc9bd70723453f82fc5bb4569cde45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:59:44Z,use_quota=True,user_id='6ea59e60de3d4dcfb58481775cc83567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516fbdb4-d3e4-4677-bf35-fd416d890b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516fbdb4-d3e4-4677-bf35-fd416d890b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfdefd8b-96ef-4542-84c7-5274f4d9cd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfdefd8b-96ef-4542-84c7-5274f4d9cd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8167e04c-2e5d-4900-a26b-0464e0004a63', 'volume_name': 'volume-8167e04c-2e5d-4900-a26b-0464e0004a63', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251cf85e-3b60-42a8-b417-b64e7da225fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251cf85e-3b60-42a8-b417-b64e7da225fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b85a78-aa2a-4f8d-8ecf-f408744fde40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:43 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Volume 8167e04c-2e5d-4900-a26b-0464e0004a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8167e04c-2e5d-4900-a26b-0464e0004a63', 'volume_size': 1} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2013134581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8167e04c-2e5d-4900-a26b-0464e0004a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0cc9bd70723453f82fc5bb4569cde45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:59:44Z,use_quota=True,user_id='6ea59e60de3d4dcfb58481775cc83567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Creating volume 8167e04c-2e5d-4900-a26b-0464e0004a63 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:59:43 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:59:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8167e04c-2e5d-4900-a26b-0464e0004a63 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:43 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8167e04c-2e5d-4900-a26b-0464e0004a63 1073741824 Jul 07 21:59:43 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:44 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d02bab94-817d-46ed-8e1f-dcabb103ef71 tempest-GroupSnapshotsV319Test-341748200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.939s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:44 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-d02bab94-817d-46ed-8e1f-dcabb103ef71 tempest-GroupSnapshotsV319Test-341748200 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:59:44 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d02bab94-817d-46ed-8e1f-dcabb103ef71 tempest-GroupSnapshotsV319Test-341748200 None] Delete group completed successfully. Jul 07 21:59:45 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8167e04c-2e5d-4900-a26b-0464e0004a63 1073741824" returned: 0 in 1.356s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8167e04c-2e5d-4900-a26b-0464e0004a63 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:45 devstack sudo[95377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8167e04c-2e5d-4900-a26b-0464e0004a63 Jul 07 21:59:45 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Flow 'volume_create_manager' (7de0dffa-94d2-4b02-8948-7269e5bd2381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56bda524-b433-4e23-9461-e4e796e902a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56bda524-b433-4e23-9461-e4e796e902a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-933008940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd778a69-67f1-4afb-a01c-c7bd8e281f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af878ea049ef4fa2ab84a8b28c6011fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:59:46Z,use_quota=True,user_id='1606d519eb534e69a3feaaae4fa99ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5117916c-8650-491c-890c-f8d6bd55927c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5117916c-8650-491c-890c-f8d6bd55927c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b005fc-9361-43cd-a43c-fb8af390b6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69b005fc-9361-43cd-a43c-fb8af390b6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd778a69-67f1-4afb-a01c-c7bd8e281f34', 'volume_name': 'volume-fd778a69-67f1-4afb-a01c-c7bd8e281f34', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d74195e-a0eb-48f2-9d5c-ca41ae233c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d74195e-a0eb-48f2-9d5c-ca41ae233c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259e4074-3861-419b-bf4a-896d23a2519b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:46 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Volume fd778a69-67f1-4afb-a01c-c7bd8e281f34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd778a69-67f1-4afb-a01c-c7bd8e281f34', 'volume_size': 1} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:46 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8167e04c-2e5d-4900-a26b-0464e0004a63" returned: 0 in 0.913s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] <== create_volume: return (2350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.352s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.110s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-933008940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd778a69-67f1-4afb-a01c-c7bd8e281f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af878ea049ef4fa2ab84a8b28c6011fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:59:46Z,use_quota=True,user_id='1606d519eb534e69a3feaaae4fa99ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Creating volume fd778a69-67f1-4afb-a01c-c7bd8e281f34 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:59:46 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd778a69-67f1-4afb-a01c-c7bd8e281f34 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b85a78-aa2a-4f8d-8ecf-f408744fde40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8167e04c-2e5d-4900-a26b-0464e0004a63', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfcfafc6-5d48-4a48-911e-9edd365dbd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:46 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd778a69-67f1-4afb-a01c-c7bd8e281f34 1073741824 Jul 07 21:59:46 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:46 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Volume volume-8167e04c-2e5d-4900-a26b-0464e0004a63 (8167e04c-2e5d-4900-a26b-0464e0004a63): created successfully Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfcfafc6-5d48-4a48-911e-9edd365dbd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Flow 'volume_create_manager' (02361783-feba-44ff-a913-a0c94ce020e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:59:46 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-2e8299e9-3187-4278-b929-1f319f2bfad9 tempest-AttachVolumeNegativeTest-648165259 None] Created volume successfully. Jul 07 21:59:47 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd778a69-67f1-4afb-a01c-c7bd8e281f34 1073741824" returned: 0 in 0.978s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd778a69-67f1-4afb-a01c-c7bd8e281f34 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:47 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd778a69-67f1-4afb-a01c-c7bd8e281f34 Jul 07 21:59:47 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:47 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd778a69-67f1-4afb-a01c-c7bd8e281f34" returned: 0 in 0.690s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:47 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:59:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259e4074-3861-419b-bf4a-896d23a2519b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd778a69-67f1-4afb-a01c-c7bd8e281f34', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d267b7d-91b6-4fe0-918f-1238e9200cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:48 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Volume volume-fd778a69-67f1-4afb-a01c-c7bd8e281f34 (fd778a69-67f1-4afb-a01c-c7bd8e281f34): created successfully Jul 07 21:59:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d267b7d-91b6-4fe0-918f-1238e9200cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Flow 'volume_create_manager' (7de0dffa-94d2-4b02-8948-7269e5bd2381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:59:48 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-a4f0ce55-8c23-4ef0-9680-8a2bee003191 tempest-VolumesMetadataTest-1754233623 None] Created volume successfully. Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Flow 'volume_create_manager' (1935534d-43c0-430b-b9e3-42990ce0ada9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e276092f-b8fe-4b76-9c24-679662b94b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e276092f-b8fe-4b76-9c24-679662b94b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1165838681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6bc7f3-adf6-4155-a2fe-eff4d632f531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caf1a999dd73416b84d0280ba68f7293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:59:50Z,use_quota=True,user_id='33e1bb677b8c419abae16f36de5eecb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b1e159-4744-40c8-8963-ee62aafdda47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b1e159-4744-40c8-8963-ee62aafdda47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b81e0ab-9bb5-425b-b645-e01d8d0b102f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b81e0ab-9bb5-425b-b645-e01d8d0b102f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab6bc7f3-adf6-4155-a2fe-eff4d632f531', 'volume_name': 'volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a463b8a-aeca-48a5-b89c-161150734ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a463b8a-aeca-48a5-b89c-161150734ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0928a383-2eb5-479c-8485-58a9ed167da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:50 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Volume ab6bc7f3-adf6-4155-a2fe-eff4d632f531: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531', 'volume_size': 1} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1165838681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6bc7f3-adf6-4155-a2fe-eff4d632f531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caf1a999dd73416b84d0280ba68f7293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:59:50Z,use_quota=True,user_id='33e1bb677b8c419abae16f36de5eecb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Creating volume ab6bc7f3-adf6-4155-a2fe-eff4d632f531 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:59:50 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:50 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531 1073741824 Jul 07 21:59:50 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-60cbbb20-3cb3-4a60-8f3f-84543a976d07 req-74eb9656-132f-4b65-8623-25fb869840ab tempest-AttachVolumeNegativeTest-648165259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0a8c7bf4-78ac-4281-8b0c-d58888c69a4e tempest-VolumesMetadataTest-1754233623 None] Acquiring lock "cinder-fd778a69-67f1-4afb-a01c-c7bd8e281f34-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0a8c7bf4-78ac-4281-8b0c-d58888c69a4e tempest-VolumesMetadataTest-1754233623 None] Lock "cinder-fd778a69-67f1-4afb-a01c-c7bd8e281f34-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0a8c7bf4-78ac-4281-8b0c-d58888c69a4e tempest-VolumesMetadataTest-1754233623 None] Acquiring lock "cinder-quobyte-fd778a69-67f1-4afb-a01c-c7bd8e281f34" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0a8c7bf4-78ac-4281-8b0c-d58888c69a4e tempest-VolumesMetadataTest-1754233623 None] Lock "cinder-quobyte-fd778a69-67f1-4afb-a01c-c7bd8e281f34" acquired by "delete_volume" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb64fb96-51c4-4fa2-a304-e87485e2b4df]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:59:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0a8c7bf4-78ac-4281-8b0c-d58888c69a4e tempest-VolumesMetadataTest-1754233623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd778a69-67f1-4afb-a01c-c7bd8e281f34 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:50 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd778a69-67f1-4afb-a01c-c7bd8e281f34 Jul 07 21:59:50 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:51 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531 1073741824" returned: 0 in 0.996s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:51 devstack sudo[95412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531 Jul 07 21:59:51 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:51 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0a8c7bf4-78ac-4281-8b0c-d58888c69a4e tempest-VolumesMetadataTest-1754233623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd778a69-67f1-4afb-a01c-c7bd8e281f34" returned: 0 in 0.939s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0a8c7bf4-78ac-4281-8b0c-d58888c69a4e tempest-VolumesMetadataTest-1754233623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd778a69-67f1-4afb-a01c-c7bd8e281f34 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:51 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd778a69-67f1-4afb-a01c-c7bd8e281f34 Jul 07 21:59:51 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:51 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531" returned: 0 in 0.695s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 21:59:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-60cbbb20-3cb3-4a60-8f3f-84543a976d07 req-74eb9656-132f-4b65-8623-25fb869840ab tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.689s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0928a383-2eb5-479c-8485-58a9ed167da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323d7c75-d0c5-45d3-a82c-921223c03f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:51 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c5f736-ca66-4e89-a33b-a43081e2ef7c]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:59:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-60cbbb20-3cb3-4a60-8f3f-84543a976d07 req-74eb9656-132f-4b65-8623-25fb869840ab tempest-AttachVolumeNegativeTest-648165259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8167e04c-2e5d-4900-a26b-0464e0004a63 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:52 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Volume volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531 (ab6bc7f3-adf6-4155-a2fe-eff4d632f531): created successfully Jul 07 21:59:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323d7c75-d0c5-45d3-a82c-921223c03f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Flow 'volume_create_manager' (1935534d-43c0-430b-b9e3-42990ce0ada9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:59:52 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-35f9e3cc-2110-49e6-b971-186be3018cfc tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Created volume successfully. Jul 07 21:59:52 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8167e04c-2e5d-4900-a26b-0464e0004a63 Jul 07 21:59:52 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:52 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0a8c7bf4-78ac-4281-8b0c-d58888c69a4e tempest-VolumesMetadataTest-1754233623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd778a69-67f1-4afb-a01c-c7bd8e281f34" returned: 0 in 0.809s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0a8c7bf4-78ac-4281-8b0c-d58888c69a4e tempest-VolumesMetadataTest-1754233623 None] Lock "cinder-quobyte-fd778a69-67f1-4afb-a01c-c7bd8e281f34" released by "delete_volume" :: held 1.805s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:59:52 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-0a8c7bf4-78ac-4281-8b0c-d58888c69a4e tempest-VolumesMetadataTest-1754233623 None] Created reservations ['56fbd1ca-5e57-43d7-a3a9-bede3a565f05', '2825c958-ee94-466e-a2e6-16af5dc0a09f', 'a8284f93-df69-4276-aa62-052d49e7eede', 'c6ec6b56-f14e-4e29-bc5c-8c72afb6385c'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 21:59:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0a8c7bf4-78ac-4281-8b0c-d58888c69a4e tempest-VolumesMetadataTest-1754233623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0a8c7bf4-78ac-4281-8b0c-d58888c69a4e tempest-VolumesMetadataTest-1754233623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0a8c7bf4-78ac-4281-8b0c-d58888c69a4e tempest-VolumesMetadataTest-1754233623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:59:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0a8c7bf4-78ac-4281-8b0c-d58888c69a4e tempest-VolumesMetadataTest-1754233623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:59:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0a8c7bf4-78ac-4281-8b0c-d58888c69a4e tempest-VolumesMetadataTest-1754233623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0a8c7bf4-78ac-4281-8b0c-d58888c69a4e tempest-VolumesMetadataTest-1754233623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:52 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 21:59:52 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:52 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-60cbbb20-3cb3-4a60-8f3f-84543a976d07 req-74eb9656-132f-4b65-8623-25fb869840ab tempest-AttachVolumeNegativeTest-648165259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8167e04c-2e5d-4900-a26b-0464e0004a63" returned: 0 in 0.949s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-60cbbb20-3cb3-4a60-8f3f-84543a976d07 req-74eb9656-132f-4b65-8623-25fb869840ab tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.003s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-60cbbb20-3cb3-4a60-8f3f-84543a976d07 req-74eb9656-132f-4b65-8623-25fb869840ab tempest-AttachVolumeNegativeTest-648165259 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491', 'name': 'volume-8167e04c-2e5d-4900-a26b-0464e0004a63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b3b3ae92-8d76-4c42-acde-d26da012bc91', 'enforce_multipath': True} {{(pid=87586) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4930}} Jul 07 21:59:53 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-60cbbb20-3cb3-4a60-8f3f-84543a976d07 req-74eb9656-132f-4b65-8623-25fb869840ab tempest-AttachVolumeNegativeTest-648165259 None] attachment_update completed successfully. Jul 07 21:59:53 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0a8c7bf4-78ac-4281-8b0c-d58888c69a4e tempest-VolumesMetadataTest-1754233623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.962s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:53 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-0a8c7bf4-78ac-4281-8b0c-d58888c69a4e tempest-VolumesMetadataTest-1754233623 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 21:59:53 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-0a8c7bf4-78ac-4281-8b0c-d58888c69a4e tempest-VolumesMetadataTest-1754233623 None] Deleted volume successfully. Jul 07 21:59:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bc841362-305d-46fb-abd6-eb196e163fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bc841362-305d-46fb-abd6-eb196e163fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:53 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0a8c7bf4-78ac-4281-8b0c-d58888c69a4e tempest-VolumesMetadataTest-1754233623 None] Lock "cinder-fd778a69-67f1-4afb-a01c-c7bd8e281f34-delete_volume" released by "delete_volume" :: held 2.998s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 21:59:53 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-bc841362-305d-46fb-abd6-eb196e163fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Creating offline snapshot 04944263-99ff-45e2-88f8-b627fda50c37 of volume ab6bc7f3-adf6-4155-a2fe-eff4d632f531 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 21:59:53 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3428c8a-c01a-42ca-aeb1-922ab078fba2]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:59:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bc841362-305d-46fb-abd6-eb196e163fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:53 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531 Jul 07 21:59:53 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:54 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bc841362-305d-46fb-abd6-eb196e163fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531" returned: 0 in 1.007s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bc841362-305d-46fb-abd6-eb196e163fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.04944263-99ff-45e2-88f8-b627fda50c37 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:54 devstack sudo[95820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.04944263-99ff-45e2-88f8-b627fda50c37 1G Jul 07 21:59:54 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:55 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bc841362-305d-46fb-abd6-eb196e163fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.04944263-99ff-45e2-88f8-b627fda50c37 1G" returned: 0 in 0.846s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bc841362-305d-46fb-abd6-eb196e163fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.04944263-99ff-45e2-88f8-b627fda50c37 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:55 devstack sudo[95826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.04944263-99ff-45e2-88f8-b627fda50c37 Jul 07 21:59:55 devstack sudo[95826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:56 devstack sudo[95826]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bc841362-305d-46fb-abd6-eb196e163fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.04944263-99ff-45e2-88f8-b627fda50c37" returned: 0 in 0.783s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:56 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-bc841362-305d-46fb-abd6-eb196e163fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.04944263-99ff-45e2-88f8-b627fda50c37 is being set with open permissions: ugo+rw Jul 07 21:59:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bc841362-305d-46fb-abd6-eb196e163fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.04944263-99ff-45e2-88f8-b627fda50c37 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:56 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.04944263-99ff-45e2-88f8-b627fda50c37 Jul 07 21:59:56 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:57 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bc841362-305d-46fb-abd6-eb196e163fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.04944263-99ff-45e2-88f8-b627fda50c37" returned: 0 in 0.832s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:57 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:INSERT=27,cinder:UPDATE=109,cinder:SELECT=93,cinder:DELETE=7 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:59:57 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=89,cinder:INSERT=25,cinder:UPDATE=115,cinder:DELETE=10 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 21:59:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bc841362-305d-46fb-abd6-eb196e163fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:57 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.info Jul 07 21:59:57 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:57 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-570c2ad2-34da-4674-9714-fafc2a8f5e17 tempest-GroupsV314Test-533267293 None] Group tempest-GroupsV314Test-Group-325594261: creating Jul 07 21:59:57 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-570c2ad2-34da-4674-9714-fafc2a8f5e17 tempest-GroupsV314Test-533267293 None] Group tempest-GroupsV314Test-Group-325594261: created successfully Jul 07 21:59:57 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-570c2ad2-34da-4674-9714-fafc2a8f5e17 tempest-GroupsV314Test-533267293 None] Create group completed successfully. Jul 07 21:59:57 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bc841362-305d-46fb-abd6-eb196e163fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.info" returned: 0 in 0.761s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:57 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-bc841362-305d-46fb-abd6-eb196e163fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.info is being set with open permissions: ugo+rw Jul 07 21:59:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bc841362-305d-46fb-abd6-eb196e163fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:58 devstack sudo[95838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.info Jul 07 21:59:58 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:58 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root Jul 07 21:59:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bc841362-305d-46fb-abd6-eb196e163fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.info" returned: 0 in 0.663s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 21:59:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bc841362-305d-46fb-abd6-eb196e163fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.036s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:58 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-bc841362-305d-46fb-abd6-eb196e163fbb tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Create snapshot completed successfully Jul 07 21:59:58 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 21:59:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Flow 'volume_create_manager' (8670a078-66c3-49ab-87f4-b913cf944ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14cd94b9-9fdc-44fa-9ffd-5dee81e2d977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14cd94b9-9fdc-44fa-9ffd-5dee81e2d977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T19:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-27467646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aa07ddf8-877f-4ab1-b464-963a4daebbd9,host='devstack@QuobyteHD#QuobyteHD',id=f9e91814-72a5-4b8f-aae8-f520ee61e114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5bce65f7c23498abc61ff0b1fe173be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:59:59Z,use_quota=True,user_id='437b08fe003e4f40a6c827a5579b1590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3711869-0fc1-410d-a0cf-01fe39f635bf),volume_type_id=f3711869-0fc1-410d-a0cf-01fe39f635bf)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95a5a5b-10c9-456e-8c3a-cbf7aa99d8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95a5a5b-10c9-456e-8c3a-cbf7aa99d8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c1f02a-be64-41f7-8d79-53843d620af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c1f02a-be64-41f7-8d79-53843d620af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9e91814-72a5-4b8f-aae8-f520ee61e114', 'volume_name': 'volume-f9e91814-72a5-4b8f-aae8-f520ee61e114', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cbdc3a2-4ee5-4f4e-bd01-0ee589bd8b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cbdc3a2-4ee5-4f4e-bd01-0ee589bd8b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43442e7-7deb-43de-999f-d38445b47c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 21:59:59 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Volume f9e91814-72a5-4b8f-aae8-f520ee61e114: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9e91814-72a5-4b8f-aae8-f520ee61e114', 'volume_size': 1} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aa07ddf8-877f-4ab1-b464-963a4daebbd9,created_at=2026-07-07T19:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-27467646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aa07ddf8-877f-4ab1-b464-963a4daebbd9,host='devstack@QuobyteHD#QuobyteHD',id=f9e91814-72a5-4b8f-aae8-f520ee61e114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5bce65f7c23498abc61ff0b1fe173be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T19:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T19:59:59Z,use_quota=True,user_id='437b08fe003e4f40a6c827a5579b1590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3711869-0fc1-410d-a0cf-01fe39f635bf),volume_type_id=f3711869-0fc1-410d-a0cf-01fe39f635bf)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Creating volume f9e91814-72a5-4b8f-aae8-f520ee61e114 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 21:59:59 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:59 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 1073741824 Jul 07 21:59:59 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b130ea49-1938-47b5-a9f1-72ef3c004238 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Acquiring lock "cinder-04944263-99ff-45e2-88f8-b627fda50c37-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b130ea49-1938-47b5-a9f1-72ef3c004238 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Lock "cinder-04944263-99ff-45e2-88f8-b627fda50c37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b130ea49-1938-47b5-a9f1-72ef3c004238 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Acquiring lock "cinder-quobyte-ab6bc7f3-adf6-4155-a2fe-eff4d632f531" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:59:59 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-4f0fa3ae-6921-4dd0-a93f-59c9ae98e581 req-a1e63051-4733-45e8-bebc-7023ee96824b tempest-AttachVolumeNegativeTest-648165259 None] Terminate volume connection completed successfully. Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-4f0fa3ae-6921-4dd0-a93f-59c9ae98e581 req-a1e63051-4733-45e8-bebc-7023ee96824b tempest-AttachVolumeNegativeTest-648165259 None] Deleting attachment b3b3ae92-8d76-4c42-acde-d26da012bc91. {{(pid=87586) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b130ea49-1938-47b5-a9f1-72ef3c004238 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Lock "cinder-quobyte-ab6bc7f3-adf6-4155-a2fe-eff4d632f531" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b130ea49-1938-47b5-a9f1-72ef3c004238 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Acquiring lock "cinder-quobyte-04944263-99ff-45e2-88f8-b627fda50c37" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b130ea49-1938-47b5-a9f1-72ef3c004238 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Lock "cinder-quobyte-04944263-99ff-45e2-88f8-b627fda50c37" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-b130ea49-1938-47b5-a9f1-72ef3c004238 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Deleting offline snapshot 04944263-99ff-45e2-88f8-b627fda50c37 of volume ab6bc7f3-adf6-4155-a2fe-eff4d632f531 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-b130ea49-1938-47b5-a9f1-72ef3c004238 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] snapshot_file for this snap is: volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.04944263-99ff-45e2-88f8-b627fda50c37 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a3541d-2485-4dc3-b8db-ee3b14969882]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 21:59:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b130ea49-1938-47b5-a9f1-72ef3c004238 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.04944263-99ff-45e2-88f8-b627fda50c37 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 21:59:59 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.04944263-99ff-45e2-88f8-b627fda50c37 Jul 07 21:59:59 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:00 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 1073741824" returned: 0 in 1.003s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:00 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 Jul 07 22:00:00 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:00 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b130ea49-1938-47b5-a9f1-72ef3c004238 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.04944263-99ff-45e2-88f8-b627fda50c37" returned: 0 in 0.926s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-b130ea49-1938-47b5-a9f1-72ef3c004238 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:00:00 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f471d5a-2827-4d10-873c-564600ccbc2b]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:00:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b130ea49-1938-47b5-a9f1-72ef3c004238 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:00 devstack sudo[95881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531 Jul 07 22:00:00 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:00 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114" returned: 0 in 0.724s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:00:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:00:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43442e7-7deb-43de-999f-d38445b47c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9e91814-72a5-4b8f-aae8-f520ee61e114', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86600f9c-4b1a-4e42-a4c8-57c9da80f04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:00 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Volume volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 (f9e91814-72a5-4b8f-aae8-f520ee61e114): created successfully Jul 07 22:00:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86600f9c-4b1a-4e42-a4c8-57c9da80f04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Flow 'volume_create_manager' (8670a078-66c3-49ab-87f4-b913cf944ebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:00:00 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-82bcc4b6-a749-43f2-a434-aa70997d1471 tempest-GroupsV314Test-533267293 None] Created volume successfully. Jul 07 22:00:01 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b130ea49-1938-47b5-a9f1-72ef3c004238 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531" returned: 0 in 1.065s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b130ea49-1938-47b5-a9f1-72ef3c004238 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.04944263-99ff-45e2-88f8-b627fda50c37 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:01 devstack sudo[95887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.04944263-99ff-45e2-88f8-b627fda50c37 Jul 07 22:00:01 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:02 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b130ea49-1938-47b5-a9f1-72ef3c004238 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.04944263-99ff-45e2-88f8-b627fda50c37" returned: 0 in 0.924s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b130ea49-1938-47b5-a9f1-72ef3c004238 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.04944263-99ff-45e2-88f8-b627fda50c37 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:02 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.04944263-99ff-45e2-88f8-b627fda50c37 Jul 07 22:00:02 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:00:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:00:02 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Cloning volume f9e91814-72a5-4b8f-aae8-f520ee61e114 to volume d24d7f5d-e591-4be7-96ed-44d5abc94ace Jul 07 22:00:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Creating offline snapshot 77302c6f-0d11-48ac-84ca-cf3f053f646a of volume f9e91814-72a5-4b8f-aae8-f520ee61e114 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:00:02 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a08afb9-d19c-46a1-9cdf-60b22e240e98]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:00:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:03 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 Jul 07 22:00:03 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:03 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b130ea49-1938-47b5-a9f1-72ef3c004238 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531.04944263-99ff-45e2-88f8-b627fda50c37" returned: 0 in 1.286s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:03 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b130ea49-1938-47b5-a9f1-72ef3c004238 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Lock "cinder-quobyte-04944263-99ff-45e2-88f8-b627fda50c37" released by "_delete_snapshot" :: held 4.355s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:00:03 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b130ea49-1938-47b5-a9f1-72ef3c004238 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Lock "cinder-quobyte-ab6bc7f3-adf6-4155-a2fe-eff4d632f531" released by "delete_snapshot" :: held 4.387s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:00:03 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-b130ea49-1938-47b5-a9f1-72ef3c004238 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Created reservations ['36a9c9dd-cb86-451e-90fa-d6cb53b38611', 'b875bf85-b71e-4af7-8b9f-be211d67fd72', '060e502d-9c40-4904-a31b-1c2fb5411fff', '8ce77733-7e80-406a-b9f6-94b122374d29'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:00:04 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-b130ea49-1938-47b5-a9f1-72ef3c004238 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Delete snapshot completed successfully. Jul 07 22:00:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b130ea49-1938-47b5-a9f1-72ef3c004238 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Lock "cinder-04944263-99ff-45e2-88f8-b627fda50c37-delete_snapshot" released by "delete_snapshot" :: held 4.601s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:00:04 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114" returned: 0 in 1.154s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:04 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a 1G Jul 07 22:00:04 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d6d872da-98b1-4c0a-b23b-66a280cf5d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Acquiring lock "cinder-ab6bc7f3-adf6-4155-a2fe-eff4d632f531-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:00:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d6d872da-98b1-4c0a-b23b-66a280cf5d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Lock "cinder-ab6bc7f3-adf6-4155-a2fe-eff4d632f531-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:00:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d6d872da-98b1-4c0a-b23b-66a280cf5d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Acquiring lock "cinder-quobyte-ab6bc7f3-adf6-4155-a2fe-eff4d632f531" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:00:05 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d6d872da-98b1-4c0a-b23b-66a280cf5d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Lock "cinder-quobyte-ab6bc7f3-adf6-4155-a2fe-eff4d632f531" acquired by "delete_volume" :: waited 0.021s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:00:05 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d73df8d-fb08-428e-86e7-f99c62bb7bd1]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:00:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d6d872da-98b1-4c0a-b23b-66a280cf5d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:05 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a 1G" returned: 0 in 1.025s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:05 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a Jul 07 22:00:05 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:05 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531 Jul 07 22:00:05 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:06 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a" returned: 0 in 0.949s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:06 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:00:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:06 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a Jul 07 22:00:06 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:06 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d6d872da-98b1-4c0a-b23b-66a280cf5d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531" returned: 0 in 1.106s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d6d872da-98b1-4c0a-b23b-66a280cf5d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:06 devstack sudo[95943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531 Jul 07 22:00:06 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:06 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a" returned: 0 in 0.801s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:07 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.info Jul 07 22:00:07 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Flow 'volume_create_manager' (606c7ffa-9a8d-4da2-b7cc-cf4d61862992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd1d096-e917-464a-a3ea-25548787b61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd1d096-e917-464a-a3ea-25548787b61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1012156888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d558151-640e-418e-8087-04c49d158e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6e153f5d3c4521ae7e14332641f972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:00:07Z,use_quota=True,user_id='811d6a199bbe4944b36cfa61f3fdb1f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9871dd13-c448-482a-a966-4f0314f13ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9871dd13-c448-482a-a966-4f0314f13ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4786f7a0-a835-4cf6-8fce-20581872864f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:07 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4786f7a0-a835-4cf6-8fce-20581872864f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d558151-640e-418e-8087-04c49d158e74', 'volume_name': 'volume-4d558151-640e-418e-8087-04c49d158e74', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38699ebb-26bf-4607-a11a-657d81289e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38699ebb-26bf-4607-a11a-657d81289e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2a3aa8-a83a-4eb0-b265-46a3bae7b5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:07 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Volume 4d558151-640e-418e-8087-04c49d158e74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d558151-640e-418e-8087-04c49d158e74', 'volume_size': 1} Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d6d872da-98b1-4c0a-b23b-66a280cf5d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6bc7f3-adf6-4155-a2fe-eff4d632f531" returned: 0 in 0.962s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d6d872da-98b1-4c0a-b23b-66a280cf5d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Lock "cinder-quobyte-ab6bc7f3-adf6-4155-a2fe-eff4d632f531" released by "delete_volume" :: held 2.158s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-d6d872da-98b1-4c0a-b23b-66a280cf5d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Created reservations ['f0bd30dc-aad5-4864-b08a-fc5e9f6df14e', 'f77ae4bc-6079-4faf-aba0-b46bb9b55aab', '2c506ada-04df-4ac3-8ec9-e61acdb27bf1', '68378c66-2889-45f8-b1e8-8630a6ec577c'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d6d872da-98b1-4c0a-b23b-66a280cf5d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d6d872da-98b1-4c0a-b23b-66a280cf5d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d6d872da-98b1-4c0a-b23b-66a280cf5d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d6d872da-98b1-4c0a-b23b-66a280cf5d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d6d872da-98b1-4c0a-b23b-66a280cf5d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d6d872da-98b1-4c0a-b23b-66a280cf5d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:07 devstack sudo[95950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:00:07 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:07 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.info" returned: 0 in 0.997s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:07 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:00:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:07 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.info Jul 07 22:00:07 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:08 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d6d872da-98b1-4c0a-b23b-66a280cf5d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.747s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:08 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-d6d872da-98b1-4c0a-b23b-66a280cf5d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:00:08 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d6d872da-98b1-4c0a-b23b-66a280cf5d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Deleted volume successfully. Jul 07 22:00:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d6d872da-98b1-4c0a-b23b-66a280cf5d97 tempest-VolumeSnapshotQuotasNegativeTestJSON-651078406 None] Lock "cinder-ab6bc7f3-adf6-4155-a2fe-eff4d632f531-delete_volume" released by "delete_volume" :: held 3.199s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:00:08 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.info" returned: 0 in 0.672s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Acquiring lock "cinder-quobyte-d24d7f5d-e591-4be7-96ed-44d5abc94ace" by "_copy_volume_from_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:00:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Lock "cinder-quobyte-d24d7f5d-e591-4be7-96ed-44d5abc94ace" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:00:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] snapshot: 77302c6f-0d11-48ac-84ca-cf3f053f646a, volume: d24d7f5d-e591-4be7-96ed-44d5abc94ace, {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:00:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:00:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:00:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:00:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:00:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:00:08 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b281895e-eadd-4caa-9796-f8b19c6f5248]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:00:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:08 devstack sudo[95959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a Jul 07 22:00:08 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:09 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a" returned: 0 in 0.797s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9e91814-72a5-4b8f-aae8-f520ee61e114(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:00:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:00:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Creating direct copy from snapshot {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:00:09 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cc8cc4-9a21-4958-b1e3-d72204054810]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:00:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:09 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 Jul 07 22:00:09 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:10 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114" returned: 0 in 0.855s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:10 devstack cinder-volume[87586]: DEBUG cinder.utils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Path /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d24d7f5d-e591-4be7-96ed-44d5abc94ace not found in is_blk_device check {{(pid=87586) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:00:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d24d7f5d-e591-4be7-96ed-44d5abc94ace {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:10 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d24d7f5d-e591-4be7-96ed-44d5abc94ace Jul 07 22:00:10 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:16 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d24d7f5d-e591-4be7-96ed-44d5abc94ace" returned: 0 in 5.932s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:16 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8408ba-b74e-4266-9bcb-17bc03bb0ec3]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:00:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:16 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 Jul 07 22:00:16 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:17 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114" returned: 0 in 0.950s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:17 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Image conversion details: src /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114, size 1024.00 MB, duration 5.93 sec, destination /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d24d7f5d-e591-4be7-96ed-44d5abc94ace {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:00:17 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Converted 1024.00 MB image at 172.59 MB/s Jul 07 22:00:17 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d24d7f5d-e591-4be7-96ed-44d5abc94ace is being set with open permissions: ugo+rw: NotImplementedError Jul 07 22:00:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d24d7f5d-e591-4be7-96ed-44d5abc94ace {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:17 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d24d7f5d-e591-4be7-96ed-44d5abc94ace Jul 07 22:00:17 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:17 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=22,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:00:17 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:00:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Flow 'volume_create_manager' (085ed7fb-88f9-4485-a2c5-1ac82f023b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:00:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae3fdea-ee11-4c32-9aed-6b43b5abddad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae3fdea-ee11-4c32-9aed-6b43b5abddad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1918914651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6340ec-b75f-409f-9447-eac8eb7855f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdc53c79ee664cfeb3aee8583ae67b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:00:17Z,use_quota=True,user_id='4f0242b86a91414480711764729a1b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6326984-ecc3-4688-b125-480d25c8b753),volume_type_id=c6326984-ecc3-4688-b125-480d25c8b753)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db9c5aa9-d3e6-441a-aa83-eea780862396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db9c5aa9-d3e6-441a-aa83-eea780862396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4afb2f8-8d8e-4ccf-a4b8-c3b8e1f235dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4afb2f8-8d8e-4ccf-a4b8-c3b8e1f235dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df6340ec-b75f-409f-9447-eac8eb7855f9', 'volume_name': 'volume-df6340ec-b75f-409f-9447-eac8eb7855f9', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b16a8d6-a14e-4c7e-8969-a1562205043d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b16a8d6-a14e-4c7e-8969-a1562205043d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab7b163-9372-4db3-98e2-53cc90bbccf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:17 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Volume df6340ec-b75f-409f-9447-eac8eb7855f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df6340ec-b75f-409f-9447-eac8eb7855f9', 'volume_size': 1} Jul 07 22:00:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:00:17 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d24d7f5d-e591-4be7-96ed-44d5abc94ace" returned: 0 in 0.701s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Lock "cinder-quobyte-d24d7f5d-e591-4be7-96ed-44d5abc94ace" released by "_copy_volume_from_snapshot" :: held 9.342s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:00:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Acquiring lock "cinder-quobyte-77302c6f-0d11-48ac-84ca-cf3f053f646a" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:00:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Lock "cinder-quobyte-77302c6f-0d11-48ac-84ca-cf3f053f646a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:00:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Deleting offline snapshot 77302c6f-0d11-48ac-84ca-cf3f053f646a of volume f9e91814-72a5-4b8f-aae8-f520ee61e114 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:00:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] snapshot_file for this snap is: volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:00:18 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8c9af2-3417-4e71-8bcd-0af4a808f462]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:00:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:18 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a Jul 07 22:00:18 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:18 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a" returned: 0 in 0.750s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9e91814-72a5-4b8f-aae8-f520ee61e114(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:00:18 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ad13e5-202e-41aa-b0a6-6e77f8549854]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:00:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:19 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 Jul 07 22:00:19 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:19 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114" returned: 0 in 0.745s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:19 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a Jul 07 22:00:19 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:20 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a" returned: 0 in 0.714s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:20 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a Jul 07 22:00:20 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:21 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114.77302c6f-0d11-48ac-84ca-cf3f053f646a" returned: 0 in 0.650s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:21 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Lock "cinder-quobyte-77302c6f-0d11-48ac-84ca-cf3f053f646a" released by "_delete_snapshot" :: held 2.953s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:00:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.215s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:00:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.947s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:00:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1012156888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d558151-640e-418e-8087-04c49d158e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e6e153f5d3c4521ae7e14332641f972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:00:07Z,use_quota=True,user_id='811d6a199bbe4944b36cfa61f3fdb1f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:00:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Creating volume 4d558151-640e-418e-8087-04c49d158e74 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:00:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:00:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:00:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:00:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:00:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:00:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:00:21 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:00:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:21 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 1073741824 Jul 07 22:00:21 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:21 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-b6f8bbef-a532-4ca8-8e6d-e9104b5f0162 tempest-GroupsV314Test-533267293 None] Create group from source-group-aa07ddf8-877f-4ab1-b464-963a4daebbd9 completed successfully. Jul 07 22:00:21 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 1073741824" returned: 0 in 0.822s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:21 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 Jul 07 22:00:21 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e92c6c76-850d-441a-9215-986d8adecfb7 tempest-GroupsV314Test-533267293 None] Acquiring lock "cinder-quobyte-d24d7f5d-e591-4be7-96ed-44d5abc94ace" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:00:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e92c6c76-850d-441a-9215-986d8adecfb7 tempest-GroupsV314Test-533267293 None] Lock "cinder-quobyte-d24d7f5d-e591-4be7-96ed-44d5abc94ace" acquired by "delete_volume" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:00:22 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd0f9df-f272-408d-8b2b-68e509de97ef]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:00:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e92c6c76-850d-441a-9215-986d8adecfb7 tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d24d7f5d-e591-4be7-96ed-44d5abc94ace {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:22 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74" returned: 0 in 0.672s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:00:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:00:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:00:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1918914651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6340ec-b75f-409f-9447-eac8eb7855f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdc53c79ee664cfeb3aee8583ae67b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:00:17Z,use_quota=True,user_id='4f0242b86a91414480711764729a1b50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6326984-ecc3-4688-b125-480d25c8b753),volume_type_id=c6326984-ecc3-4688-b125-480d25c8b753)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:00:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Creating volume df6340ec-b75f-409f-9447-eac8eb7855f9 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:00:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:00:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:00:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:00:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:00:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:00:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:00:22 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:00:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df6340ec-b75f-409f-9447-eac8eb7855f9 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2a3aa8-a83a-4eb0-b265-46a3bae7b5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d558151-640e-418e-8087-04c49d158e74', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:22 devstack sudo[96033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df6340ec-b75f-409f-9447-eac8eb7855f9 1073741824 Jul 07 22:00:22 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87bc85d9-7e2e-4daf-a45e-2e44e2a35cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:22 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Volume volume-4d558151-640e-418e-8087-04c49d158e74 (4d558151-640e-418e-8087-04c49d158e74): created successfully Jul 07 22:00:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87bc85d9-7e2e-4daf-a45e-2e44e2a35cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Flow 'volume_create_manager' (606c7ffa-9a8d-4da2-b7cc-cf4d61862992) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:00:22 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d24d7f5d-e591-4be7-96ed-44d5abc94ace Jul 07 22:00:22 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:22 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-2df0b535-153c-4b9f-adb0-6523976dd122 tempest-VolumesActionsTest-1681444817 None] Created volume successfully. Jul 07 22:00:23 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e92c6c76-850d-441a-9215-986d8adecfb7 tempest-GroupsV314Test-533267293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d24d7f5d-e591-4be7-96ed-44d5abc94ace" returned: 0 in 0.925s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e92c6c76-850d-441a-9215-986d8adecfb7 tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d24d7f5d-e591-4be7-96ed-44d5abc94ace {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:23 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d24d7f5d-e591-4be7-96ed-44d5abc94ace Jul 07 22:00:23 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:23 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df6340ec-b75f-409f-9447-eac8eb7855f9 1073741824" returned: 0 in 1.268s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df6340ec-b75f-409f-9447-eac8eb7855f9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:23 devstack sudo[96045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df6340ec-b75f-409f-9447-eac8eb7855f9 Jul 07 22:00:23 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:24 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e92c6c76-850d-441a-9215-986d8adecfb7 tempest-GroupsV314Test-533267293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d24d7f5d-e591-4be7-96ed-44d5abc94ace" returned: 0 in 0.961s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e92c6c76-850d-441a-9215-986d8adecfb7 tempest-GroupsV314Test-533267293 None] Lock "cinder-quobyte-d24d7f5d-e591-4be7-96ed-44d5abc94ace" released by "delete_volume" :: held 1.949s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:00:24 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-e92c6c76-850d-441a-9215-986d8adecfb7 tempest-GroupsV314Test-533267293 None] Created reservations ['40bc5d55-6285-4b99-b2d8-d9c0d5a66274'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:00:24 devstack cinder-volume[87586]: WARNING cinder.quota [None req-e92c6c76-850d-441a-9215-986d8adecfb7 tempest-GroupsV314Test-533267293 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-379063072 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-379063072, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:00:24 devstack cinder-volume[87586]: WARNING cinder.quota [None req-e92c6c76-850d-441a-9215-986d8adecfb7 tempest-GroupsV314Test-533267293 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-379063072 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-379063072, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:00:24 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-e92c6c76-850d-441a-9215-986d8adecfb7 tempest-GroupsV314Test-533267293 None] Created reservations ['1ec44c2b-9a4a-4ac4-b80a-cba66b1c9522', 'aa4110ea-b968-47bb-aa1b-545aed33a97c', '70548bc9-92e0-4ae2-90ed-58d530b1f460', 'aa12fcd4-b0b6-4cad-b4cf-0057bd380c99'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:00:24 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df6340ec-b75f-409f-9447-eac8eb7855f9" returned: 0 in 0.839s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] <== create_volume: return (2171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:00:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.174s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:00:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab7b163-9372-4db3-98e2-53cc90bbccf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df6340ec-b75f-409f-9447-eac8eb7855f9', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f45e8194-5db0-4c26-917b-cd539de63687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e92c6c76-850d-441a-9215-986d8adecfb7 tempest-GroupsV314Test-533267293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:00:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e92c6c76-850d-441a-9215-986d8adecfb7 tempest-GroupsV314Test-533267293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:00:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e92c6c76-850d-441a-9215-986d8adecfb7 tempest-GroupsV314Test-533267293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:00:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e92c6c76-850d-441a-9215-986d8adecfb7 tempest-GroupsV314Test-533267293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:00:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e92c6c76-850d-441a-9215-986d8adecfb7 tempest-GroupsV314Test-533267293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:00:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e92c6c76-850d-441a-9215-986d8adecfb7 tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:24 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Volume volume-df6340ec-b75f-409f-9447-eac8eb7855f9 (df6340ec-b75f-409f-9447-eac8eb7855f9): created successfully Jul 07 22:00:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f45e8194-5db0-4c26-917b-cd539de63687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Flow 'volume_create_manager' (085ed7fb-88f9-4485-a2c5-1ac82f023b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:00:24 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-2d3476ba-4f4e-4b8d-b89b-a255b7dcd0b3 tempest-VolumeTypesAccessTest-1697193006 None] Created volume successfully. Jul 07 22:00:24 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:00:24 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-602feef7-722c-4777-b863-d87f01b88644 tempest-VolumeTypesAccessTest-1697193006 None] Acquiring lock "cinder-df6340ec-b75f-409f-9447-eac8eb7855f9-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:00:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-602feef7-722c-4777-b863-d87f01b88644 tempest-VolumeTypesAccessTest-1697193006 None] Lock "cinder-df6340ec-b75f-409f-9447-eac8eb7855f9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:00:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-602feef7-722c-4777-b863-d87f01b88644 tempest-VolumeTypesAccessTest-1697193006 None] Acquiring lock "cinder-quobyte-df6340ec-b75f-409f-9447-eac8eb7855f9" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:00:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-602feef7-722c-4777-b863-d87f01b88644 tempest-VolumeTypesAccessTest-1697193006 None] Lock "cinder-quobyte-df6340ec-b75f-409f-9447-eac8eb7855f9" acquired by "delete_volume" :: waited 0.036s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:00:25 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[be95b678-de6c-488c-9534-904c28350903]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:00:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-602feef7-722c-4777-b863-d87f01b88644 tempest-VolumeTypesAccessTest-1697193006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df6340ec-b75f-409f-9447-eac8eb7855f9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:25 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df6340ec-b75f-409f-9447-eac8eb7855f9 Jul 07 22:00:25 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-20d07b0c-8635-4028-bad6-26814dde0d9b tempest-GroupsV314Test-533267293 None] Acquiring lock "cinder-quobyte-f9e91814-72a5-4b8f-aae8-f520ee61e114" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:00:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-20d07b0c-8635-4028-bad6-26814dde0d9b tempest-GroupsV314Test-533267293 None] Lock "cinder-quobyte-f9e91814-72a5-4b8f-aae8-f520ee61e114" acquired by "delete_volume" :: waited 0.023s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:00:25 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9ec049-c2c0-4dab-b011-a0ab3976ebcc]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:00:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-20d07b0c-8635-4028-bad6-26814dde0d9b tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:26 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 Jul 07 22:00:26 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:26 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e92c6c76-850d-441a-9215-986d8adecfb7 tempest-GroupsV314Test-533267293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.284s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:26 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-e92c6c76-850d-441a-9215-986d8adecfb7 tempest-GroupsV314Test-533267293 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:00:26 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-e92c6c76-850d-441a-9215-986d8adecfb7 tempest-GroupsV314Test-533267293 None] Delete group completed successfully. Jul 07 22:00:26 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-602feef7-722c-4777-b863-d87f01b88644 tempest-VolumeTypesAccessTest-1697193006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df6340ec-b75f-409f-9447-eac8eb7855f9" returned: 0 in 1.154s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-602feef7-722c-4777-b863-d87f01b88644 tempest-VolumeTypesAccessTest-1697193006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df6340ec-b75f-409f-9447-eac8eb7855f9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:26 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df6340ec-b75f-409f-9447-eac8eb7855f9 Jul 07 22:00:26 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:26 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-20d07b0c-8635-4028-bad6-26814dde0d9b tempest-GroupsV314Test-533267293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114" returned: 0 in 0.998s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-20d07b0c-8635-4028-bad6-26814dde0d9b tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:26 devstack sudo[96083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114 Jul 07 22:00:26 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:27 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-602feef7-722c-4777-b863-d87f01b88644 tempest-VolumeTypesAccessTest-1697193006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df6340ec-b75f-409f-9447-eac8eb7855f9" returned: 0 in 0.806s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-602feef7-722c-4777-b863-d87f01b88644 tempest-VolumeTypesAccessTest-1697193006 None] Lock "cinder-quobyte-df6340ec-b75f-409f-9447-eac8eb7855f9" released by "delete_volume" :: held 2.042s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:00:27 devstack cinder-volume[87586]: WARNING cinder.quota [None req-602feef7-722c-4777-b863-d87f01b88644 tempest-VolumeTypesAccessTest-1697193006 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1314109908 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1314109908, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:00:27 devstack cinder-volume[87586]: WARNING cinder.quota [None req-602feef7-722c-4777-b863-d87f01b88644 tempest-VolumeTypesAccessTest-1697193006 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1314109908 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1314109908, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:00:27 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-602feef7-722c-4777-b863-d87f01b88644 tempest-VolumeTypesAccessTest-1697193006 None] Created reservations ['ad13c87b-c43e-4c5f-a89f-5fad19575fff', '8965a35d-2744-4716-884b-3d022150b045', 'f3518f6b-6c13-4ab1-babd-60dac3ffbf89', 'd7ab647c-4406-4e75-9685-4a7efe3c9499'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:00:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-602feef7-722c-4777-b863-d87f01b88644 tempest-VolumeTypesAccessTest-1697193006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:00:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-602feef7-722c-4777-b863-d87f01b88644 tempest-VolumeTypesAccessTest-1697193006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:00:27 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-602feef7-722c-4777-b863-d87f01b88644 tempest-VolumeTypesAccessTest-1697193006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:00:27 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-602feef7-722c-4777-b863-d87f01b88644 tempest-VolumeTypesAccessTest-1697193006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:00:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-602feef7-722c-4777-b863-d87f01b88644 tempest-VolumeTypesAccessTest-1697193006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:00:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-602feef7-722c-4777-b863-d87f01b88644 tempest-VolumeTypesAccessTest-1697193006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:27 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-20d07b0c-8635-4028-bad6-26814dde0d9b tempest-GroupsV314Test-533267293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f9e91814-72a5-4b8f-aae8-f520ee61e114" returned: 0 in 0.772s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:27 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:00:27 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-20d07b0c-8635-4028-bad6-26814dde0d9b tempest-GroupsV314Test-533267293 None] Lock "cinder-quobyte-f9e91814-72a5-4b8f-aae8-f520ee61e114" released by "delete_volume" :: held 1.889s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:00:27 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-20d07b0c-8635-4028-bad6-26814dde0d9b tempest-GroupsV314Test-533267293 None] Created reservations ['a26d331c-3a79-48ad-a15c-b3ece216bad0'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:00:27 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-20d07b0c-8635-4028-bad6-26814dde0d9b tempest-GroupsV314Test-533267293 None] Created reservations ['76638dc2-8cfc-4fd7-b098-0a672f4411d9', '837b4e2b-48ef-44b8-bcd7-100bfd863e33', 'fd1e06c3-41ad-4dd9-9154-50ed2b96e1a9', 'aff5d1d3-999e-4335-85da-a738e3657047'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:00:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-20d07b0c-8635-4028-bad6-26814dde0d9b tempest-GroupsV314Test-533267293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:00:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-20d07b0c-8635-4028-bad6-26814dde0d9b tempest-GroupsV314Test-533267293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:00:27 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-20d07b0c-8635-4028-bad6-26814dde0d9b tempest-GroupsV314Test-533267293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:00:27 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-20d07b0c-8635-4028-bad6-26814dde0d9b tempest-GroupsV314Test-533267293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:00:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-20d07b0c-8635-4028-bad6-26814dde0d9b tempest-GroupsV314Test-533267293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:00:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-20d07b0c-8635-4028-bad6-26814dde0d9b tempest-GroupsV314Test-533267293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:27 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:00:27 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:28 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-602feef7-722c-4777-b863-d87f01b88644 tempest-VolumeTypesAccessTest-1697193006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.688s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:28 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-602feef7-722c-4777-b863-d87f01b88644 tempest-VolumeTypesAccessTest-1697193006 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:00:28 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-602feef7-722c-4777-b863-d87f01b88644 tempest-VolumeTypesAccessTest-1697193006 None] Deleted volume successfully. Jul 07 22:00:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-602feef7-722c-4777-b863-d87f01b88644 tempest-VolumeTypesAccessTest-1697193006 None] Lock "cinder-df6340ec-b75f-409f-9447-eac8eb7855f9-delete_volume" released by "delete_volume" :: held 3.032s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:00:28 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-20d07b0c-8635-4028-bad6-26814dde0d9b tempest-GroupsV314Test-533267293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.757s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:28 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-20d07b0c-8635-4028-bad6-26814dde0d9b tempest-GroupsV314Test-533267293 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:00:28 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-20d07b0c-8635-4028-bad6-26814dde0d9b tempest-GroupsV314Test-533267293 None] Delete group completed successfully. Jul 07 22:00:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:00:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:00:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:00:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:00:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:00:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:00:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:35 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:00:35 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:36 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.241s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:00:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:00:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 8 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 22:00:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 22:00:37 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=51,cinder:UPDATE=58,cinder:INSERT=13,cinder:DELETE=2 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:00:38 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=25,cinder:UPDATE=32,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:00:45 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-66870fef-189e-406a-a831-9f1c5153ef79 tempest-VolumesActionsTest-1681444817 None] Acquiring lock "cinder-4d558151-640e-418e-8087-04c49d158e74" by "attach_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:00:45 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-66870fef-189e-406a-a831-9f1c5153ef79 tempest-VolumesActionsTest-1681444817 None] Lock "cinder-4d558151-640e-418e-8087-04c49d158e74" acquired by "attach_volume" :: waited 0.035s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:00:45 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-66870fef-189e-406a-a831-9f1c5153ef79 tempest-VolumesActionsTest-1681444817 None] Attaching volume 4d558151-640e-418e-8087-04c49d158e74 to instance fbbd5694-3507-48fa-8a70-353e65970d60 at mountpoint /dev/vdb on host None. Jul 07 22:00:45 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-66870fef-189e-406a-a831-9f1c5153ef79 tempest-VolumesActionsTest-1681444817 None] Attach volume completed successfully. Jul 07 22:00:45 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-66870fef-189e-406a-a831-9f1c5153ef79 tempest-VolumesActionsTest-1681444817 None] Lock "cinder-4d558151-640e-418e-8087-04c49d158e74" released by "attach_volume" :: held 0.182s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:00:45 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e646dce5-4756-434d-9ec1-896ffa50ce1a tempest-VolumesActionsTest-1681444817 None] Acquiring lock "cinder-4d558151-640e-418e-8087-04c49d158e74-detach_volume" by "detach_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:00:45 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e646dce5-4756-434d-9ec1-896ffa50ce1a tempest-VolumesActionsTest-1681444817 None] Lock "cinder-4d558151-640e-418e-8087-04c49d158e74-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:00:45 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-e646dce5-4756-434d-9ec1-896ffa50ce1a tempest-VolumesActionsTest-1681444817 None] Detaching volume 4d558151-640e-418e-8087-04c49d158e74 from instance fbbd5694-3507-48fa-8a70-353e65970d60. Jul 07 22:00:46 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-e646dce5-4756-434d-9ec1-896ffa50ce1a tempest-VolumesActionsTest-1681444817 None] Detach volume completed successfully. Jul 07 22:00:46 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e646dce5-4756-434d-9ec1-896ffa50ce1a tempest-VolumesActionsTest-1681444817 None] Lock "cinder-4d558151-640e-418e-8087-04c49d158e74-detach_volume" released by "detach_volume" :: held 0.092s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:00:47 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:00:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Flow 'volume_create_manager' (afe857be-c352-4a3b-a07e-ce395eaba6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:00:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1308f4d-ad1e-4783-a3d1-f0407515fc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1308f4d-ad1e-4783-a3d1-f0407515fc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-836408539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97490ae-9a8e-4ad6-a2f3-5cb198c76532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03637d1eb3ad4cdbafc81b044e5281be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:00:47Z,use_quota=True,user_id='ffa3e75df54f4c4aac55fd9cc830e4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e71738ca-2d07-467f-b0cc-a54874f284b3),volume_type_id=e71738ca-2d07-467f-b0cc-a54874f284b3)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194c4f36-0885-4caf-9084-83e604f92f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194c4f36-0885-4caf-9084-83e604f92f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c235ca72-e4f8-49af-8a4d-754289c1f0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c235ca72-e4f8-49af-8a4d-754289c1f0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e97490ae-9a8e-4ad6-a2f3-5cb198c76532', 'volume_name': 'volume-e97490ae-9a8e-4ad6-a2f3-5cb198c76532', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f43b6f-77a7-42eb-bd32-3c4c3716261e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f43b6f-77a7-42eb-bd32-3c4c3716261e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea206a0-182f-433f-b692-e0bd6c69ca64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:47 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Volume e97490ae-9a8e-4ad6-a2f3-5cb198c76532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e97490ae-9a8e-4ad6-a2f3-5cb198c76532', 'volume_size': 1} Jul 07 22:00:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:00:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:00:47 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-836408539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97490ae-9a8e-4ad6-a2f3-5cb198c76532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03637d1eb3ad4cdbafc81b044e5281be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:00:47Z,use_quota=True,user_id='ffa3e75df54f4c4aac55fd9cc830e4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e71738ca-2d07-467f-b0cc-a54874f284b3),volume_type_id=e71738ca-2d07-467f-b0cc-a54874f284b3)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:00:47 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Creating volume e97490ae-9a8e-4ad6-a2f3-5cb198c76532 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:00:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:00:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:00:47 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:00:47 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:00:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:00:47 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:00:47 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:00:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e97490ae-9a8e-4ad6-a2f3-5cb198c76532 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:47 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e97490ae-9a8e-4ad6-a2f3-5cb198c76532 1073741824 Jul 07 22:00:47 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:48 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e97490ae-9a8e-4ad6-a2f3-5cb198c76532 1073741824" returned: 0 in 0.922s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e97490ae-9a8e-4ad6-a2f3-5cb198c76532 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:48 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e97490ae-9a8e-4ad6-a2f3-5cb198c76532 Jul 07 22:00:48 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:49 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e97490ae-9a8e-4ad6-a2f3-5cb198c76532" returned: 0 in 0.863s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:49 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:00:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:00:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea206a0-182f-433f-b692-e0bd6c69ca64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e97490ae-9a8e-4ad6-a2f3-5cb198c76532', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9889519-ee36-465a-8b4c-b8fa89c1ce56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:49 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Volume volume-e97490ae-9a8e-4ad6-a2f3-5cb198c76532 (e97490ae-9a8e-4ad6-a2f3-5cb198c76532): created successfully Jul 07 22:00:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9889519-ee36-465a-8b4c-b8fa89c1ce56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Flow 'volume_create_manager' (afe857be-c352-4a3b-a07e-ce395eaba6f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:00:49 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-02dd2c66-556d-4209-95e7-44d5db875c90 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Created volume successfully. Jul 07 22:00:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-41f3d170-0972-42e9-b0de-8fee2292cdef tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:00:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-41f3d170-0972-42e9-b0de-8fee2292cdef tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:00:49 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-41f3d170-0972-42e9-b0de-8fee2292cdef tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:00:49 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-41f3d170-0972-42e9-b0de-8fee2292cdef tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:00:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-41f3d170-0972-42e9-b0de-8fee2292cdef tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:00:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-41f3d170-0972-42e9-b0de-8fee2292cdef tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:49 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:00:49 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Flow 'volume_create_manager' (451ea920-9603-4024-b338-58b87187bc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33abd4b7-e418-4276-9de6-32b3792b7cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:50 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-41f3d170-0972-42e9-b0de-8fee2292cdef tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.779s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-41f3d170-0972-42e9-b0de-8fee2292cdef tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33abd4b7-e418-4276-9de6-32b3792b7cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-411022756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fc9b50-ba34-42e4-aad3-2c522f3bd2e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c632ade80cc4304a9fe8f5ba0b479b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:00:50Z,use_quota=True,user_id='d559e859c0d9451cbb480f39306989f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63f4a40-21f0-4937-90de-4650592d5a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63f4a40-21f0-4937-90de-4650592d5a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206dbb63-4a92-4a90-9945-389faac32a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206dbb63-4a92-4a90-9945-389faac32a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23fc9b50-ba34-42e4-aad3-2c522f3bd2e2', 'volume_name': 'volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d22bce12-5166-460a-88b2-566985b038ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d22bce12-5166-460a-88b2-566985b038ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61ad4db-8528-46d4-bb24-2451aad16bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:50 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Volume 23fc9b50-ba34-42e4-aad3-2c522f3bd2e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2', 'volume_size': 1} Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-411022756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fc9b50-ba34-42e4-aad3-2c522f3bd2e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c632ade80cc4304a9fe8f5ba0b479b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:00:50Z,use_quota=True,user_id='d559e859c0d9451cbb480f39306989f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Creating volume 23fc9b50-ba34-42e4-aad3-2c522f3bd2e2 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:00:50 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:50 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-41f3d170-0972-42e9-b0de-8fee2292cdef tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Retype volume completed successfully. Jul 07 22:00:50 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2 1073741824 Jul 07 22:00:50 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:50 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b878010b-a547-4a33-9ffc-c152fc820020 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Acquiring lock "cinder-e97490ae-9a8e-4ad6-a2f3-5cb198c76532-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:00:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b878010b-a547-4a33-9ffc-c152fc820020 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Lock "cinder-e97490ae-9a8e-4ad6-a2f3-5cb198c76532-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:00:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b878010b-a547-4a33-9ffc-c152fc820020 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Acquiring lock "cinder-quobyte-e97490ae-9a8e-4ad6-a2f3-5cb198c76532" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:00:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b878010b-a547-4a33-9ffc-c152fc820020 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Lock "cinder-quobyte-e97490ae-9a8e-4ad6-a2f3-5cb198c76532" acquired by "delete_volume" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:00:51 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea6fcb9-a991-4b96-9365-d459d6caf462]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:00:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b878010b-a547-4a33-9ffc-c152fc820020 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e97490ae-9a8e-4ad6-a2f3-5cb198c76532 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:51 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e97490ae-9a8e-4ad6-a2f3-5cb198c76532 Jul 07 22:00:51 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:51 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2 1073741824" returned: 0 in 1.016s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:51 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2 Jul 07 22:00:51 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:51 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b878010b-a547-4a33-9ffc-c152fc820020 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e97490ae-9a8e-4ad6-a2f3-5cb198c76532" returned: 0 in 0.825s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b878010b-a547-4a33-9ffc-c152fc820020 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e97490ae-9a8e-4ad6-a2f3-5cb198c76532 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:51 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e97490ae-9a8e-4ad6-a2f3-5cb198c76532 Jul 07 22:00:51 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:52 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2" returned: 0 in 0.682s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:00:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:00:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61ad4db-8528-46d4-bb24-2451aad16bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86f05175-3943-4e2b-9b94-65b45b93c589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:52 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Volume volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2 (23fc9b50-ba34-42e4-aad3-2c522f3bd2e2): created successfully Jul 07 22:00:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86f05175-3943-4e2b-9b94-65b45b93c589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Flow 'volume_create_manager' (451ea920-9603-4024-b338-58b87187bc7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:00:52 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-2a30c06f-964b-4f61-a7d7-03c5897f4fcc tempest-SnapshotMetadataTestJSON-757167318 None] Created volume successfully. Jul 07 22:00:52 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b878010b-a547-4a33-9ffc-c152fc820020 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e97490ae-9a8e-4ad6-a2f3-5cb198c76532" returned: 0 in 0.680s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b878010b-a547-4a33-9ffc-c152fc820020 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Lock "cinder-quobyte-e97490ae-9a8e-4ad6-a2f3-5cb198c76532" released by "delete_volume" :: held 1.563s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:00:52 devstack cinder-volume[87586]: WARNING cinder.quota [None req-b878010b-a547-4a33-9ffc-c152fc820020 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:00:52 devstack cinder-volume[87586]: WARNING cinder.quota [None req-b878010b-a547-4a33-9ffc-c152fc820020 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:00:52 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-b878010b-a547-4a33-9ffc-c152fc820020 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Created reservations ['05617163-8cbc-4fcc-8ef8-596767d8df70', 'e59f5d45-bfde-4df8-896c-217213047e5d', '09d6e04e-1d89-406d-9b2b-f00916816635', '372d0c35-fc47-46a8-87de-2d4d2564e07f'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:00:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e70b5a26-1b1a-4051-a333-7c181ad11349 tempest-SnapshotMetadataTestJSON-757167318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:00:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e70b5a26-1b1a-4051-a333-7c181ad11349 tempest-SnapshotMetadataTestJSON-757167318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:00:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-e70b5a26-1b1a-4051-a333-7c181ad11349 tempest-SnapshotMetadataTestJSON-757167318 None] Creating offline snapshot 6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2 of volume 23fc9b50-ba34-42e4-aad3-2c522f3bd2e2 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:00:52 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[65664e6d-ee54-41e8-bf72-6ceb489fc356]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:00:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e70b5a26-1b1a-4051-a333-7c181ad11349 tempest-SnapshotMetadataTestJSON-757167318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b878010b-a547-4a33-9ffc-c152fc820020 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:00:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b878010b-a547-4a33-9ffc-c152fc820020 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:00:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b878010b-a547-4a33-9ffc-c152fc820020 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:00:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b878010b-a547-4a33-9ffc-c152fc820020 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:00:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b878010b-a547-4a33-9ffc-c152fc820020 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:00:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b878010b-a547-4a33-9ffc-c152fc820020 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:52 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:00:52 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:52 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2 Jul 07 22:00:52 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:53 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b878010b-a547-4a33-9ffc-c152fc820020 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.748s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:53 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-b878010b-a547-4a33-9ffc-c152fc820020 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:00:53 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-b878010b-a547-4a33-9ffc-c152fc820020 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Deleted volume successfully. Jul 07 22:00:53 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b878010b-a547-4a33-9ffc-c152fc820020 tempest-VolumeRetypeWithoutMigrationTest-1867963515 None] Lock "cinder-e97490ae-9a8e-4ad6-a2f3-5cb198c76532-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:00:53 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e70b5a26-1b1a-4051-a333-7c181ad11349 tempest-SnapshotMetadataTestJSON-757167318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2" returned: 0 in 0.916s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e70b5a26-1b1a-4051-a333-7c181ad11349 tempest-SnapshotMetadataTestJSON-757167318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:53 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2 1G Jul 07 22:00:53 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:54 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e70b5a26-1b1a-4051-a333-7c181ad11349 tempest-SnapshotMetadataTestJSON-757167318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2 1G" returned: 0 in 0.906s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e70b5a26-1b1a-4051-a333-7c181ad11349 tempest-SnapshotMetadataTestJSON-757167318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:54 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2 Jul 07 22:00:54 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:55 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e70b5a26-1b1a-4051-a333-7c181ad11349 tempest-SnapshotMetadataTestJSON-757167318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2" returned: 0 in 0.821s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:55 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-e70b5a26-1b1a-4051-a333-7c181ad11349 tempest-SnapshotMetadataTestJSON-757167318 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2 is being set with open permissions: ugo+rw Jul 07 22:00:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e70b5a26-1b1a-4051-a333-7c181ad11349 tempest-SnapshotMetadataTestJSON-757167318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:55 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2 Jul 07 22:00:55 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:56 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e70b5a26-1b1a-4051-a333-7c181ad11349 tempest-SnapshotMetadataTestJSON-757167318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2" returned: 0 in 0.710s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e70b5a26-1b1a-4051-a333-7c181ad11349 tempest-SnapshotMetadataTestJSON-757167318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:56 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.info Jul 07 22:00:56 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:56 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:00:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Flow 'volume_create_manager' (9827a09d-2d2c-416b-9550-08027b1b9acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:00:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35c0091-f0c3-4ed3-84be-298e5152f5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35c0091-f0c3-4ed3-84be-298e5152f5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-816032607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff471ef3-fdd1-430d-a03d-956b364eacfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0cc9bd70723453f82fc5bb4569cde45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:00:57Z,use_quota=True,user_id='6ea59e60de3d4dcfb58481775cc83567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6e118b-c3a3-413f-9509-dc1df9513ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6e118b-c3a3-413f-9509-dc1df9513ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f7a2e63-4b87-4d25-bdd6-ec32e3a4cce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f7a2e63-4b87-4d25-bdd6-ec32e3a4cce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff471ef3-fdd1-430d-a03d-956b364eacfc', 'volume_name': 'volume-ff471ef3-fdd1-430d-a03d-956b364eacfc', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1386d934-a429-49c3-8c9f-fc28a46261cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1386d934-a429-49c3-8c9f-fc28a46261cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc8e209-cde1-4ea4-814f-ed7338f01545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:56 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Volume ff471ef3-fdd1-430d-a03d-956b364eacfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff471ef3-fdd1-430d-a03d-956b364eacfc', 'volume_size': 1} Jul 07 22:00:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:00:56 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e70b5a26-1b1a-4051-a333-7c181ad11349 tempest-SnapshotMetadataTestJSON-757167318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.info" returned: 0 in 0.721s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:56 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-e70b5a26-1b1a-4051-a333-7c181ad11349 tempest-SnapshotMetadataTestJSON-757167318 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.info is being set with open permissions: ugo+rw Jul 07 22:00:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e70b5a26-1b1a-4051-a333-7c181ad11349 tempest-SnapshotMetadataTestJSON-757167318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:56 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.info Jul 07 22:00:56 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:57 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e70b5a26-1b1a-4051-a333-7c181ad11349 tempest-SnapshotMetadataTestJSON-757167318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.info" returned: 0 in 0.701s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e70b5a26-1b1a-4051-a333-7c181ad11349 tempest-SnapshotMetadataTestJSON-757167318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.885s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:00:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.867s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:00:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-816032607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff471ef3-fdd1-430d-a03d-956b364eacfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0cc9bd70723453f82fc5bb4569cde45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:00:57Z,use_quota=True,user_id='6ea59e60de3d4dcfb58481775cc83567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:00:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Creating volume ff471ef3-fdd1-430d-a03d-956b364eacfc {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:00:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:00:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:00:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:00:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:00:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:00:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:00:57 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:00:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ff471ef3-fdd1-430d-a03d-956b364eacfc 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:57 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ff471ef3-fdd1-430d-a03d-956b364eacfc 1073741824 Jul 07 22:00:57 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:57 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-e70b5a26-1b1a-4051-a333-7c181ad11349 tempest-SnapshotMetadataTestJSON-757167318 None] Create snapshot completed successfully Jul 07 22:00:58 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ff471ef3-fdd1-430d-a03d-956b364eacfc 1073741824" returned: 0 in 0.926s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ff471ef3-fdd1-430d-a03d-956b364eacfc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:58 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ff471ef3-fdd1-430d-a03d-956b364eacfc Jul 07 22:00:58 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:58 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4da4bd89-c067-4257-b12c-dbb9d8a3b97b tempest-SnapshotMetadataTestJSON-757167318 None] Acquiring lock "cinder-6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:00:58 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4da4bd89-c067-4257-b12c-dbb9d8a3b97b tempest-SnapshotMetadataTestJSON-757167318 None] Lock "cinder-6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:00:58 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4da4bd89-c067-4257-b12c-dbb9d8a3b97b tempest-SnapshotMetadataTestJSON-757167318 None] Acquiring lock "cinder-quobyte-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:00:58 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4da4bd89-c067-4257-b12c-dbb9d8a3b97b tempest-SnapshotMetadataTestJSON-757167318 None] Lock "cinder-quobyte-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:00:58 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4da4bd89-c067-4257-b12c-dbb9d8a3b97b tempest-SnapshotMetadataTestJSON-757167318 None] Acquiring lock "cinder-quobyte-6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:00:58 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4da4bd89-c067-4257-b12c-dbb9d8a3b97b tempest-SnapshotMetadataTestJSON-757167318 None] Lock "cinder-quobyte-6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:00:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-4da4bd89-c067-4257-b12c-dbb9d8a3b97b tempest-SnapshotMetadataTestJSON-757167318 None] Deleting offline snapshot 6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2 of volume 23fc9b50-ba34-42e4-aad3-2c522f3bd2e2 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:00:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-4da4bd89-c067-4257-b12c-dbb9d8a3b97b tempest-SnapshotMetadataTestJSON-757167318 None] snapshot_file for this snap is: volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:00:58 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5bafbc-b8ae-4fe5-b8ea-75a6c8fd1c7a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:00:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4da4bd89-c067-4257-b12c-dbb9d8a3b97b tempest-SnapshotMetadataTestJSON-757167318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:59 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2 Jul 07 22:00:59 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Flow 'volume_create_manager' (71d95743-2572-4d77-abf8-be19ba111c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e707a0b0-7ad8-4078-a4e2-7b8e21fc92b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e707a0b0-7ad8-4078-a4e2-7b8e21fc92b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1416231693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a4fb997-dab5-45c7-8723-d83b2e2ff6ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de841435dbd4e08985a8936072511fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:00:59Z,use_quota=True,user_id='8c5fdfccd37547719cde8a288a84e7b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4405b4f-9346-4a27-9369-bdbe31258afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4405b4f-9346-4a27-9369-bdbe31258afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa59629a-6812-41ed-94b3-cb0e278840f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa59629a-6812-41ed-94b3-cb0e278840f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a4fb997-dab5-45c7-8723-d83b2e2ff6ed', 'volume_name': 'volume-5a4fb997-dab5-45c7-8723-d83b2e2ff6ed', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9315a8-7584-4bb5-90aa-aaf6a19a82c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9315a8-7584-4bb5-90aa-aaf6a19a82c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6894894d-720c-4340-a970-a8b24af2e0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:59 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Volume 5a4fb997-dab5-45c7-8723-d83b2e2ff6ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a4fb997-dab5-45c7-8723-d83b2e2ff6ed', 'volume_size': 1} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:00:59 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ff471ef3-fdd1-430d-a03d-956b364eacfc" returned: 0 in 0.798s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.228s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1416231693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a4fb997-dab5-45c7-8723-d83b2e2ff6ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de841435dbd4e08985a8936072511fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:00:59Z,use_quota=True,user_id='8c5fdfccd37547719cde8a288a84e7b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Creating volume 5a4fb997-dab5-45c7-8723-d83b2e2ff6ed {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:00:59 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a4fb997-dab5-45c7-8723-d83b2e2ff6ed 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:59 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a4fb997-dab5-45c7-8723-d83b2e2ff6ed 1073741824 Jul 07 22:00:59 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc8e209-cde1-4ea4-814f-ed7338f01545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff471ef3-fdd1-430d-a03d-956b364eacfc', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e92e86c-be49-4d97-8411-5926b782ca4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:00:59 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Volume volume-ff471ef3-fdd1-430d-a03d-956b364eacfc (ff471ef3-fdd1-430d-a03d-956b364eacfc): created successfully Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e92e86c-be49-4d97-8411-5926b782ca4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Flow 'volume_create_manager' (9827a09d-2d2c-416b-9550-08027b1b9acb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:00:59 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-297a1786-4fed-4fe1-8127-2c0f92bec3c9 tempest-AttachVolumeNegativeTest-648165259 None] Created volume successfully. Jul 07 22:00:59 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4da4bd89-c067-4257-b12c-dbb9d8a3b97b tempest-SnapshotMetadataTestJSON-757167318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2" returned: 0 in 0.859s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-4da4bd89-c067-4257-b12c-dbb9d8a3b97b tempest-SnapshotMetadataTestJSON-757167318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[461d88f4-8185-45f9-ada4-5a6980db3fdf]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:00:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4da4bd89-c067-4257-b12c-dbb9d8a3b97b tempest-SnapshotMetadataTestJSON-757167318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:00:59 devstack sudo[96421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2 Jul 07 22:00:59 devstack sudo[96421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:00 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a4fb997-dab5-45c7-8723-d83b2e2ff6ed 1073741824" returned: 0 in 1.006s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a4fb997-dab5-45c7-8723-d83b2e2ff6ed {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:00 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a4fb997-dab5-45c7-8723-d83b2e2ff6ed Jul 07 22:01:00 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:00 devstack sudo[96421]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4da4bd89-c067-4257-b12c-dbb9d8a3b97b tempest-SnapshotMetadataTestJSON-757167318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2" returned: 0 in 1.063s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4da4bd89-c067-4257-b12c-dbb9d8a3b97b tempest-SnapshotMetadataTestJSON-757167318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:00 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2 Jul 07 22:01:00 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:01 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a4fb997-dab5-45c7-8723-d83b2e2ff6ed" returned: 0 in 0.801s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:01 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:01:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6894894d-720c-4340-a970-a8b24af2e0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a4fb997-dab5-45c7-8723-d83b2e2ff6ed', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da2ecb4-60b6-429e-b34a-e5a1a07ad5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:01 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Volume volume-5a4fb997-dab5-45c7-8723-d83b2e2ff6ed (5a4fb997-dab5-45c7-8723-d83b2e2ff6ed): created successfully Jul 07 22:01:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da2ecb4-60b6-429e-b34a-e5a1a07ad5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Flow 'volume_create_manager' (71d95743-2572-4d77-abf8-be19ba111c86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:01:01 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-7d1fecb2-ea49-4609-ab90-6d3de06df43d tempest-VolumesListAdminTestJSON-807627094 None] Created volume successfully. Jul 07 22:01:01 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4da4bd89-c067-4257-b12c-dbb9d8a3b97b tempest-SnapshotMetadataTestJSON-757167318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2" returned: 0 in 0.876s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4da4bd89-c067-4257-b12c-dbb9d8a3b97b tempest-SnapshotMetadataTestJSON-757167318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:01 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2 Jul 07 22:01:01 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:02 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4da4bd89-c067-4257-b12c-dbb9d8a3b97b tempest-SnapshotMetadataTestJSON-757167318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2.6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2" returned: 0 in 0.769s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4da4bd89-c067-4257-b12c-dbb9d8a3b97b tempest-SnapshotMetadataTestJSON-757167318 None] Lock "cinder-quobyte-6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2" released by "_delete_snapshot" :: held 3.740s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:01:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4da4bd89-c067-4257-b12c-dbb9d8a3b97b tempest-SnapshotMetadataTestJSON-757167318 None] Lock "cinder-quobyte-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2" released by "delete_snapshot" :: held 3.764s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:01:02 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-4da4bd89-c067-4257-b12c-dbb9d8a3b97b tempest-SnapshotMetadataTestJSON-757167318 None] Created reservations ['5efd4eb5-7573-496c-a3df-1c7ecc62eb3b', '2562b336-2dde-43a1-814c-8a074ef1d1a3', '7516ef28-9023-45e2-9317-c5442da07fbe', '34756df7-a42e-4901-a23d-18a85b31612a'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:01:02 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-4da4bd89-c067-4257-b12c-dbb9d8a3b97b tempest-SnapshotMetadataTestJSON-757167318 None] Delete snapshot completed successfully. Jul 07 22:01:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4da4bd89-c067-4257-b12c-dbb9d8a3b97b tempest-SnapshotMetadataTestJSON-757167318 None] Lock "cinder-6f6f30dd-2bb8-42e7-8439-d9ff614e8cf2-delete_snapshot" released by "delete_snapshot" :: held 4.055s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:01:02 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:01:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Flow 'volume_create_manager' (d01eec99-362e-4f2c-b652-468b9bb992af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:01:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6821cd30-c6f5-45c2-977d-d44979ea7a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6821cd30-c6f5-45c2-977d-d44979ea7a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1693391987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de841435dbd4e08985a8936072511fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:01:03Z,use_quota=True,user_id='8c5fdfccd37547719cde8a288a84e7b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ba2380-3b5c-4346-bc24-ffb11ee2fae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ba2380-3b5c-4346-bc24-ffb11ee2fae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030ab0af-c1f4-4130-9b1f-335c5d657e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030ab0af-c1f4-4130-9b1f-335c5d657e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b', 'volume_name': 'volume-ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f95fbc4-18ac-4d22-a103-0e9c6895a491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f95fbc4-18ac-4d22-a103-0e9c6895a491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48a89c0-d2d0-44ff-ab1a-4c0f58fbf923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:03 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Volume ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b', 'volume_size': 1} Jul 07 22:01:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1693391987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de841435dbd4e08985a8936072511fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:01:03Z,use_quota=True,user_id='8c5fdfccd37547719cde8a288a84e7b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:01:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Creating volume ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:01:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:01:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:01:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:01:03 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:01:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:03 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b 1073741824 Jul 07 22:01:03 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:03 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-056663ee-b3b1-44e5-bc94-bd3f71292183 tempest-SnapshotMetadataTestJSON-757167318 None] Acquiring lock "cinder-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:03 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-056663ee-b3b1-44e5-bc94-bd3f71292183 tempest-SnapshotMetadataTestJSON-757167318 None] Lock "cinder-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:03 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-056663ee-b3b1-44e5-bc94-bd3f71292183 tempest-SnapshotMetadataTestJSON-757167318 None] Acquiring lock "cinder-quobyte-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:03 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-056663ee-b3b1-44e5-bc94-bd3f71292183 tempest-SnapshotMetadataTestJSON-757167318 None] Lock "cinder-quobyte-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2" acquired by "delete_volume" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:03 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fefa0a6-d2dc-4a6b-9869-73badef89e6a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:01:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-056663ee-b3b1-44e5-bc94-bd3f71292183 tempest-SnapshotMetadataTestJSON-757167318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-7f4db42f-b8bc-4e99-9d43-058e07e6bdb8 req-0cf076f6-c1bf-4359-a777-bf90ecd0e061 tempest-AttachVolumeNegativeTest-648165259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:03 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2 Jul 07 22:01:03 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:03 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b 1073741824" returned: 0 in 0.963s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:04 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b Jul 07 22:01:04 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:04 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-056663ee-b3b1-44e5-bc94-bd3f71292183 tempest-SnapshotMetadataTestJSON-757167318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2" returned: 0 in 0.807s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-056663ee-b3b1-44e5-bc94-bd3f71292183 tempest-SnapshotMetadataTestJSON-757167318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:04 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2 Jul 07 22:01:04 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:04 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b" returned: 0 in 0.697s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:04 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:01:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-7f4db42f-b8bc-4e99-9d43-058e07e6bdb8 req-0cf076f6-c1bf-4359-a777-bf90ecd0e061 tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.390s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48a89c0-d2d0-44ff-ab1a-4c0f58fbf923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc40eeb-e96a-4bb5-a123-49bb7762228e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:04 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2decfca8-33e9-4c50-a1e0-22ded10662b7]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:01:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-7f4db42f-b8bc-4e99-9d43-058e07e6bdb8 req-0cf076f6-c1bf-4359-a777-bf90ecd0e061 tempest-AttachVolumeNegativeTest-648165259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ff471ef3-fdd1-430d-a03d-956b364eacfc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:04 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Volume volume-ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b (ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b): created successfully Jul 07 22:01:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc40eeb-e96a-4bb5-a123-49bb7762228e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Flow 'volume_create_manager' (d01eec99-362e-4f2c-b652-468b9bb992af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:01:04 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-0dc299c4-bf9b-4fd0-a693-b17289af05cf tempest-VolumesListAdminTestJSON-807627094 None] Created volume successfully. Jul 07 22:01:04 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-056663ee-b3b1-44e5-bc94-bd3f71292183 tempest-SnapshotMetadataTestJSON-757167318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2" returned: 0 in 0.731s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-056663ee-b3b1-44e5-bc94-bd3f71292183 tempest-SnapshotMetadataTestJSON-757167318 None] Lock "cinder-quobyte-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2" released by "delete_volume" :: held 1.638s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:01:04 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ff471ef3-fdd1-430d-a03d-956b364eacfc Jul 07 22:01:04 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:04 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-056663ee-b3b1-44e5-bc94-bd3f71292183 tempest-SnapshotMetadataTestJSON-757167318 None] Created reservations ['129df193-d039-412a-b667-e2be7fcb709a', '84a63bc3-1d30-494d-88f5-84b1c04ef98e', '51c092e3-1a10-46c4-a9ef-2ecd2303b984', 'd2e19104-d758-4807-9923-96b1fc297d1f'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:01:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-056663ee-b3b1-44e5-bc94-bd3f71292183 tempest-SnapshotMetadataTestJSON-757167318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-056663ee-b3b1-44e5-bc94-bd3f71292183 tempest-SnapshotMetadataTestJSON-757167318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:05 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-056663ee-b3b1-44e5-bc94-bd3f71292183 tempest-SnapshotMetadataTestJSON-757167318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:01:05 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-056663ee-b3b1-44e5-bc94-bd3f71292183 tempest-SnapshotMetadataTestJSON-757167318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:01:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-056663ee-b3b1-44e5-bc94-bd3f71292183 tempest-SnapshotMetadataTestJSON-757167318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-056663ee-b3b1-44e5-bc94-bd3f71292183 tempest-SnapshotMetadataTestJSON-757167318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:05 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:01:05 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:06 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-7f4db42f-b8bc-4e99-9d43-058e07e6bdb8 req-0cf076f6-c1bf-4359-a777-bf90ecd0e061 tempest-AttachVolumeNegativeTest-648165259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ff471ef3-fdd1-430d-a03d-956b364eacfc" returned: 0 in 1.240s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-7f4db42f-b8bc-4e99-9d43-058e07e6bdb8 req-0cf076f6-c1bf-4359-a777-bf90ecd0e061 tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.288s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Flow 'volume_create_manager' (7cdaf69f-6284-450e-9cae-1aec08566800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e01969-9101-4e82-b942-f28edf80fec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e01969-9101-4e82-b942-f28edf80fec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-659890954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38080673-191d-4f1d-9e8d-3ec632289405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de841435dbd4e08985a8936072511fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:01:06Z,use_quota=True,user_id='8c5fdfccd37547719cde8a288a84e7b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41855c72-3350-4c40-babf-49a6669ce8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41855c72-3350-4c40-babf-49a6669ce8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15dcb535-75d1-4054-b728-3ca10d54658b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15dcb535-75d1-4054-b728-3ca10d54658b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38080673-191d-4f1d-9e8d-3ec632289405', 'volume_name': 'volume-38080673-191d-4f1d-9e8d-3ec632289405', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b267932-5860-4af6-a68b-a11d3c8b92a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b267932-5860-4af6-a68b-a11d3c8b92a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d650be59-ada0-437f-ba06-3ad40d26cc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:06 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Volume 38080673-191d-4f1d-9e8d-3ec632289405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38080673-191d-4f1d-9e8d-3ec632289405', 'volume_size': 1} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-659890954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38080673-191d-4f1d-9e8d-3ec632289405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de841435dbd4e08985a8936072511fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:01:06Z,use_quota=True,user_id='8c5fdfccd37547719cde8a288a84e7b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Creating volume 38080673-191d-4f1d-9e8d-3ec632289405 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:01:06 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-38080673-191d-4f1d-9e8d-3ec632289405 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-7f4db42f-b8bc-4e99-9d43-058e07e6bdb8 req-0cf076f6-c1bf-4359-a777-bf90ecd0e061 tempest-AttachVolumeNegativeTest-648165259 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491', 'name': 'volume-ff471ef3-fdd1-430d-a03d-956b364eacfc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f6d148bd-92e7-4be0-9011-fe2e27887d2b', 'enforce_multipath': True} {{(pid=87586) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4930}} Jul 07 22:01:06 devstack sudo[96528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-38080673-191d-4f1d-9e8d-3ec632289405 1073741824 Jul 07 22:01:06 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:06 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-056663ee-b3b1-44e5-bc94-bd3f71292183 tempest-SnapshotMetadataTestJSON-757167318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.226s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-056663ee-b3b1-44e5-bc94-bd3f71292183 tempest-SnapshotMetadataTestJSON-757167318 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:01:06 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-056663ee-b3b1-44e5-bc94-bd3f71292183 tempest-SnapshotMetadataTestJSON-757167318 None] Deleted volume successfully. Jul 07 22:01:06 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-056663ee-b3b1-44e5-bc94-bd3f71292183 tempest-SnapshotMetadataTestJSON-757167318 None] Lock "cinder-23fc9b50-ba34-42e4-aad3-2c522f3bd2e2-delete_volume" released by "delete_volume" :: held 3.210s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:01:06 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-7f4db42f-b8bc-4e99-9d43-058e07e6bdb8 req-0cf076f6-c1bf-4359-a777-bf90ecd0e061 tempest-AttachVolumeNegativeTest-648165259 None] attachment_update completed successfully. Jul 07 22:01:07 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-38080673-191d-4f1d-9e8d-3ec632289405 1073741824" returned: 0 in 1.326s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-38080673-191d-4f1d-9e8d-3ec632289405 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:07 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-38080673-191d-4f1d-9e8d-3ec632289405 Jul 07 22:01:07 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:08 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-38080673-191d-4f1d-9e8d-3ec632289405" returned: 0 in 1.093s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] <== create_volume: return (2469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:01:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.472s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d650be59-ada0-437f-ba06-3ad40d26cc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38080673-191d-4f1d-9e8d-3ec632289405', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636df944-b32a-41c5-a290-1bd8f073848d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:08 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Volume volume-38080673-191d-4f1d-9e8d-3ec632289405 (38080673-191d-4f1d-9e8d-3ec632289405): created successfully Jul 07 22:01:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636df944-b32a-41c5-a290-1bd8f073848d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Flow 'volume_create_manager' (7cdaf69f-6284-450e-9cae-1aec08566800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:01:08 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-8cd0728c-e89f-41ac-98c7-e8c6463fb0d6 tempest-VolumesListAdminTestJSON-807627094 None] Created volume successfully. Jul 07 22:01:10 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:01:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Flow 'volume_create_manager' (4f011bd2-4c52-445e-a9d6-09116cf2442b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:01:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc7f759e-89ff-4607-aeac-44f1f42bfdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc7f759e-89ff-4607-aeac-44f1f42bfdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df2fca36-a6d5-468a-9226-fbe5ab7f141a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c962d3b9cbe34634ae4c9b2969cbf10f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:01:10Z,use_quota=True,user_id='47bd4e6323dc4390a6d16d4303a8f9c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e9f3dd-2627-414f-8e3d-ce05b3a894e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e9f3dd-2627-414f-8e3d-ce05b3a894e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba59291-16c3-4a32-9dc0-e032cec19e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba59291-16c3-4a32-9dc0-e032cec19e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df2fca36-a6d5-468a-9226-fbe5ab7f141a', 'volume_name': 'volume-df2fca36-a6d5-468a-9226-fbe5ab7f141a', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bcf608-0ef5-496d-9548-1cc8b7184055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bcf608-0ef5-496d-9548-1cc8b7184055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d91060a-6cb9-4289-bcb4-f53da13929e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:10 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Volume df2fca36-a6d5-468a-9226-fbe5ab7f141a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df2fca36-a6d5-468a-9226-fbe5ab7f141a', 'volume_size': 1} Jul 07 22:01:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df2fca36-a6d5-468a-9226-fbe5ab7f141a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c962d3b9cbe34634ae4c9b2969cbf10f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:01:10Z,use_quota=True,user_id='47bd4e6323dc4390a6d16d4303a8f9c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:01:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Creating volume df2fca36-a6d5-468a-9226-fbe5ab7f141a {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:01:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:01:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:01:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:01:10 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:01:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df2fca36-a6d5-468a-9226-fbe5ab7f141a 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:10 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df2fca36-a6d5-468a-9226-fbe5ab7f141a 1073741824 Jul 07 22:01:10 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b1cfe7e0-aa60-4fdc-86e3-0fd165a816f0 tempest-VolumesActionsTest-1681444817 None] Acquiring lock "cinder-4d558151-640e-418e-8087-04c49d158e74" by "attach_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b1cfe7e0-aa60-4fdc-86e3-0fd165a816f0 tempest-VolumesActionsTest-1681444817 None] Lock "cinder-4d558151-640e-418e-8087-04c49d158e74" acquired by "attach_volume" :: waited 0.031s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:11 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-b1cfe7e0-aa60-4fdc-86e3-0fd165a816f0 tempest-VolumesActionsTest-1681444817 None] Attaching volume 4d558151-640e-418e-8087-04c49d158e74 to instance d5549acb-ea75-4d71-86fd-2f490624127f at mountpoint /dev/vdb on host None. Jul 07 22:01:11 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-b1cfe7e0-aa60-4fdc-86e3-0fd165a816f0 tempest-VolumesActionsTest-1681444817 None] Attach volume completed successfully. Jul 07 22:01:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b1cfe7e0-aa60-4fdc-86e3-0fd165a816f0 tempest-VolumesActionsTest-1681444817 None] Lock "cinder-4d558151-640e-418e-8087-04c49d158e74" released by "attach_volume" :: held 0.133s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:01:11 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df2fca36-a6d5-468a-9226-fbe5ab7f141a 1073741824" returned: 0 in 1.409s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df2fca36-a6d5-468a-9226-fbe5ab7f141a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:11 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df2fca36-a6d5-468a-9226-fbe5ab7f141a Jul 07 22:01:11 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3374d435-a8ec-4e7e-a3bd-52ff7a24b5f6 tempest-VolumesActionsTest-1681444817 None] Acquiring lock "cinder-4d558151-640e-418e-8087-04c49d158e74-detach_volume" by "detach_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3374d435-a8ec-4e7e-a3bd-52ff7a24b5f6 tempest-VolumesActionsTest-1681444817 None] Lock "cinder-4d558151-640e-418e-8087-04c49d158e74-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:11 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-3374d435-a8ec-4e7e-a3bd-52ff7a24b5f6 tempest-VolumesActionsTest-1681444817 None] Detaching volume 4d558151-640e-418e-8087-04c49d158e74 from instance d5549acb-ea75-4d71-86fd-2f490624127f. Jul 07 22:01:11 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-3374d435-a8ec-4e7e-a3bd-52ff7a24b5f6 tempest-VolumesActionsTest-1681444817 None] Detach volume completed successfully. Jul 07 22:01:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3374d435-a8ec-4e7e-a3bd-52ff7a24b5f6 tempest-VolumesActionsTest-1681444817 None] Lock "cinder-4d558151-640e-418e-8087-04c49d158e74-detach_volume" released by "detach_volume" :: held 0.074s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:01:12 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df2fca36-a6d5-468a-9226-fbe5ab7f141a" returned: 0 in 0.944s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:12 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] <== create_volume: return (2431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:01:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.440s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:12 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d91060a-6cb9-4289-bcb4-f53da13929e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df2fca36-a6d5-468a-9226-fbe5ab7f141a', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:12 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907d64c0-c050-427d-8f24-8191d4f62064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:12 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Volume volume-df2fca36-a6d5-468a-9226-fbe5ab7f141a (df2fca36-a6d5-468a-9226-fbe5ab7f141a): created successfully Jul 07 22:01:12 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907d64c0-c050-427d-8f24-8191d4f62064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:12 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Flow 'volume_create_manager' (4f011bd2-4c52-445e-a9d6-09116cf2442b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:01:12 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-b5bfc4bb-1dfb-49f0-b0e9-e6918b301a82 tempest-VolumesListAdminTestJSON-1721227852 None] Created volume successfully. Jul 07 22:01:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1790a825-21d3-4ab6-b9c6-5f6ca73de378 tempest-VolumesListAdminTestJSON-1721227852 None] Acquiring lock "cinder-df2fca36-a6d5-468a-9226-fbe5ab7f141a-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1790a825-21d3-4ab6-b9c6-5f6ca73de378 tempest-VolumesListAdminTestJSON-1721227852 None] Lock "cinder-df2fca36-a6d5-468a-9226-fbe5ab7f141a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1790a825-21d3-4ab6-b9c6-5f6ca73de378 tempest-VolumesListAdminTestJSON-1721227852 None] Acquiring lock "cinder-quobyte-df2fca36-a6d5-468a-9226-fbe5ab7f141a" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:13 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-9c8f8401-811e-4538-af5d-6d17f849770e req-be2cbffd-6368-4f7c-8009-c108a2dcecc0 tempest-AttachVolumeNegativeTest-648165259 None] Terminate volume connection completed successfully. Jul 07 22:01:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-9c8f8401-811e-4538-af5d-6d17f849770e req-be2cbffd-6368-4f7c-8009-c108a2dcecc0 tempest-AttachVolumeNegativeTest-648165259 None] Deleting attachment f6d148bd-92e7-4be0-9011-fe2e27887d2b. {{(pid=87586) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 07 22:01:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1790a825-21d3-4ab6-b9c6-5f6ca73de378 tempest-VolumesListAdminTestJSON-1721227852 None] Lock "cinder-quobyte-df2fca36-a6d5-468a-9226-fbe5ab7f141a" acquired by "delete_volume" :: waited 0.043s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:13 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80aa944-19f2-4fe1-9bff-0db88d70f722]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:01:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1790a825-21d3-4ab6-b9c6-5f6ca73de378 tempest-VolumesListAdminTestJSON-1721227852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df2fca36-a6d5-468a-9226-fbe5ab7f141a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-275a3f3c-c857-4251-a53a-821c1bfab42d tempest-VolumesListAdminTestJSON-807627094 None] Acquiring lock "cinder-38080673-191d-4f1d-9e8d-3ec632289405-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-275a3f3c-c857-4251-a53a-821c1bfab42d tempest-VolumesListAdminTestJSON-807627094 None] Lock "cinder-38080673-191d-4f1d-9e8d-3ec632289405-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:13 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df2fca36-a6d5-468a-9226-fbe5ab7f141a Jul 07 22:01:13 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-275a3f3c-c857-4251-a53a-821c1bfab42d tempest-VolumesListAdminTestJSON-807627094 None] Acquiring lock "cinder-quobyte-38080673-191d-4f1d-9e8d-3ec632289405" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-275a3f3c-c857-4251-a53a-821c1bfab42d tempest-VolumesListAdminTestJSON-807627094 None] Lock "cinder-quobyte-38080673-191d-4f1d-9e8d-3ec632289405" acquired by "delete_volume" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:13 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d2cad3-ffc9-4d04-a883-8de1087085e0]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:01:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-275a3f3c-c857-4251-a53a-821c1bfab42d tempest-VolumesListAdminTestJSON-807627094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-38080673-191d-4f1d-9e8d-3ec632289405 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:13 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:01:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Flow 'volume_create_manager' (e108e455-8365-486e-84f8-2928be388c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:01:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf474c6-cdc9-4082-b107-df38843af086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf474c6-cdc9-4082-b107-df38843af086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1986494968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c120577e-ef1c-488a-8bbd-43600e261979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6ee1d6ac5344cd80816628b6bab90c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:01:14Z,use_quota=True,user_id='0246f35133004d509343ee9e880a798d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576e96e3-4076-4bb8-a8fc-0a2d4dcaca93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576e96e3-4076-4bb8-a8fc-0a2d4dcaca93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a26f92-fa3c-481c-b7d6-c76775758a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a26f92-fa3c-481c-b7d6-c76775758a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c120577e-ef1c-488a-8bbd-43600e261979', 'volume_name': 'volume-c120577e-ef1c-488a-8bbd-43600e261979', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b956538e-fbf8-4c25-925e-9ce230f193c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b956538e-fbf8-4c25-925e-9ce230f193c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc629e2-0ef9-436b-9157-9d675617b4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:14 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Volume c120577e-ef1c-488a-8bbd-43600e261979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c120577e-ef1c-488a-8bbd-43600e261979', 'volume_size': 1} Jul 07 22:01:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1986494968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c120577e-ef1c-488a-8bbd-43600e261979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6ee1d6ac5344cd80816628b6bab90c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:01:14Z,use_quota=True,user_id='0246f35133004d509343ee9e880a798d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:01:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Creating volume c120577e-ef1c-488a-8bbd-43600e261979 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:01:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:01:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:01:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:01:14 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:01:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:14 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-38080673-191d-4f1d-9e8d-3ec632289405 Jul 07 22:01:14 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:14 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979 1073741824 Jul 07 22:01:14 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:14 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1790a825-21d3-4ab6-b9c6-5f6ca73de378 tempest-VolumesListAdminTestJSON-1721227852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df2fca36-a6d5-468a-9226-fbe5ab7f141a" returned: 0 in 1.014s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1790a825-21d3-4ab6-b9c6-5f6ca73de378 tempest-VolumesListAdminTestJSON-1721227852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df2fca36-a6d5-468a-9226-fbe5ab7f141a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:14 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df2fca36-a6d5-468a-9226-fbe5ab7f141a Jul 07 22:01:14 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:14 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-275a3f3c-c857-4251-a53a-821c1bfab42d tempest-VolumesListAdminTestJSON-807627094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-38080673-191d-4f1d-9e8d-3ec632289405" returned: 0 in 1.109s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-275a3f3c-c857-4251-a53a-821c1bfab42d tempest-VolumesListAdminTestJSON-807627094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-38080673-191d-4f1d-9e8d-3ec632289405 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:15 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-38080673-191d-4f1d-9e8d-3ec632289405 Jul 07 22:01:15 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:15 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979 1073741824" returned: 0 in 1.350s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:15 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979 Jul 07 22:01:15 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:15 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1790a825-21d3-4ab6-b9c6-5f6ca73de378 tempest-VolumesListAdminTestJSON-1721227852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df2fca36-a6d5-468a-9226-fbe5ab7f141a" returned: 0 in 1.154s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1790a825-21d3-4ab6-b9c6-5f6ca73de378 tempest-VolumesListAdminTestJSON-1721227852 None] Lock "cinder-quobyte-df2fca36-a6d5-468a-9226-fbe5ab7f141a" released by "delete_volume" :: held 2.252s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:01:15 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-1790a825-21d3-4ab6-b9c6-5f6ca73de378 tempest-VolumesListAdminTestJSON-1721227852 None] Created reservations ['6d0fbe44-11a2-4853-8737-5291c04fc746', 'c049dfec-416f-48c4-a05c-5fce00386bcf', '3fd5f717-8233-4cb6-ad6b-54bdbdd0a6dd', '1f49c1e9-6bf9-4372-9283-74d96c1d73fb'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1790a825-21d3-4ab6-b9c6-5f6ca73de378 tempest-VolumesListAdminTestJSON-1721227852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1790a825-21d3-4ab6-b9c6-5f6ca73de378 tempest-VolumesListAdminTestJSON-1721227852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1790a825-21d3-4ab6-b9c6-5f6ca73de378 tempest-VolumesListAdminTestJSON-1721227852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1790a825-21d3-4ab6-b9c6-5f6ca73de378 tempest-VolumesListAdminTestJSON-1721227852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1790a825-21d3-4ab6-b9c6-5f6ca73de378 tempest-VolumesListAdminTestJSON-1721227852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1790a825-21d3-4ab6-b9c6-5f6ca73de378 tempest-VolumesListAdminTestJSON-1721227852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:16 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:01:16 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:16 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-275a3f3c-c857-4251-a53a-821c1bfab42d tempest-VolumesListAdminTestJSON-807627094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-38080673-191d-4f1d-9e8d-3ec632289405" returned: 0 in 1.150s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-275a3f3c-c857-4251-a53a-821c1bfab42d tempest-VolumesListAdminTestJSON-807627094 None] Lock "cinder-quobyte-38080673-191d-4f1d-9e8d-3ec632289405" released by "delete_volume" :: held 2.307s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-275a3f3c-c857-4251-a53a-821c1bfab42d tempest-VolumesListAdminTestJSON-807627094 None] Created reservations ['63da43ee-2674-4f03-8041-cedc0da51acf', '6d6e57c1-1660-45a7-b61b-4b09655cf002', 'ac6d1238-839c-4d5e-b348-97091a87c18a', 'd1dd5615-23fa-4d4c-b14f-6422ad378d6a'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-275a3f3c-c857-4251-a53a-821c1bfab42d tempest-VolumesListAdminTestJSON-807627094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-275a3f3c-c857-4251-a53a-821c1bfab42d tempest-VolumesListAdminTestJSON-807627094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-275a3f3c-c857-4251-a53a-821c1bfab42d tempest-VolumesListAdminTestJSON-807627094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-275a3f3c-c857-4251-a53a-821c1bfab42d tempest-VolumesListAdminTestJSON-807627094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-275a3f3c-c857-4251-a53a-821c1bfab42d tempest-VolumesListAdminTestJSON-807627094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-275a3f3c-c857-4251-a53a-821c1bfab42d tempest-VolumesListAdminTestJSON-807627094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:16 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979" returned: 0 in 0.945s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] <== create_volume: return (2371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.374s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:16 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:01:16 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc629e2-0ef9-436b-9157-9d675617b4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c120577e-ef1c-488a-8bbd-43600e261979', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bade20-0b45-4d9e-be13-d843c6d5de3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:16 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Volume volume-c120577e-ef1c-488a-8bbd-43600e261979 (c120577e-ef1c-488a-8bbd-43600e261979): created successfully Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bade20-0b45-4d9e-be13-d843c6d5de3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Flow 'volume_create_manager' (e108e455-8365-486e-84f8-2928be388c44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:01:16 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-1aaa9647-4b4e-4146-bcfd-27d606942597 tempest-VolumesDeleteCascade-1260294996 None] Created volume successfully. Jul 07 22:01:16 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1790a825-21d3-4ab6-b9c6-5f6ca73de378 tempest-VolumesListAdminTestJSON-1721227852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.703s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-1790a825-21d3-4ab6-b9c6-5f6ca73de378 tempest-VolumesListAdminTestJSON-1721227852 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:01:16 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-1790a825-21d3-4ab6-b9c6-5f6ca73de378 tempest-VolumesListAdminTestJSON-1721227852 None] Deleted volume successfully. Jul 07 22:01:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1790a825-21d3-4ab6-b9c6-5f6ca73de378 tempest-VolumesListAdminTestJSON-1721227852 None] Lock "cinder-df2fca36-a6d5-468a-9226-fbe5ab7f141a-delete_volume" released by "delete_volume" :: held 3.355s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:01:17 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-275a3f3c-c857-4251-a53a-821c1bfab42d tempest-VolumesListAdminTestJSON-807627094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.806s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:17 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-275a3f3c-c857-4251-a53a-821c1bfab42d tempest-VolumesListAdminTestJSON-807627094 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:01:17 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-275a3f3c-c857-4251-a53a-821c1bfab42d tempest-VolumesListAdminTestJSON-807627094 None] Deleted volume successfully. Jul 07 22:01:17 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-275a3f3c-c857-4251-a53a-821c1bfab42d tempest-VolumesListAdminTestJSON-807627094 None] Lock "cinder-38080673-191d-4f1d-9e8d-3ec632289405-delete_volume" released by "delete_volume" :: held 3.419s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:01:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-73859707-a60d-4119-b561-dc6353c17172 tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-73859707-a60d-4119-b561-dc6353c17172 tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:17 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5ef92bd6-8e2c-4951-929f-3d0609b17b7c tempest-VolumesListAdminTestJSON-807627094 None] Acquiring lock "cinder-ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:17 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-73859707-a60d-4119-b561-dc6353c17172 tempest-VolumesDeleteCascade-1260294996 None] Creating offline snapshot 206d4bdc-824b-4a62-82d2-5e03c3a12237 of volume c120577e-ef1c-488a-8bbd-43600e261979 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:01:17 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5ef92bd6-8e2c-4951-929f-3d0609b17b7c tempest-VolumesListAdminTestJSON-807627094 None] Lock "cinder-ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:17 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ab8729-05f4-4dd0-9a07-2436a9085c6f]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:01:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-73859707-a60d-4119-b561-dc6353c17172 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:17 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5ef92bd6-8e2c-4951-929f-3d0609b17b7c tempest-VolumesListAdminTestJSON-807627094 None] Acquiring lock "cinder-quobyte-ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:17 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5ef92bd6-8e2c-4951-929f-3d0609b17b7c tempest-VolumesListAdminTestJSON-807627094 None] Lock "cinder-quobyte-ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b" acquired by "delete_volume" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:17 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfc6637-e664-40cb-ac88-28d6a8699de0]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:01:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5ef92bd6-8e2c-4951-929f-3d0609b17b7c tempest-VolumesListAdminTestJSON-807627094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:17 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979 Jul 07 22:01:17 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:17 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b Jul 07 22:01:17 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:18 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-73859707-a60d-4119-b561-dc6353c17172 tempest-VolumesDeleteCascade-1260294996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979" returned: 0 in 1.018s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-73859707-a60d-4119-b561-dc6353c17172 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:18 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237 1G Jul 07 22:01:18 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:18 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5ef92bd6-8e2c-4951-929f-3d0609b17b7c tempest-VolumesListAdminTestJSON-807627094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b" returned: 0 in 1.075s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5ef92bd6-8e2c-4951-929f-3d0609b17b7c tempest-VolumesListAdminTestJSON-807627094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:18 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b Jul 07 22:01:18 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:19 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5ef92bd6-8e2c-4951-929f-3d0609b17b7c tempest-VolumesListAdminTestJSON-807627094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b" returned: 0 in 0.676s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5ef92bd6-8e2c-4951-929f-3d0609b17b7c tempest-VolumesListAdminTestJSON-807627094 None] Lock "cinder-quobyte-ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b" released by "delete_volume" :: held 1.809s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:01:19 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-5ef92bd6-8e2c-4951-929f-3d0609b17b7c tempest-VolumesListAdminTestJSON-807627094 None] Created reservations ['60e8ffbe-50ab-440c-9c7a-667144abf671', '2b7036ab-631a-4166-bccf-9d9eb5e874ad', '6c6a30f4-0b87-4c6a-8ac1-ea5cd91914a5', 'e442ca68-e6e2-4b88-a593-90c24559cc52'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:01:19 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5ef92bd6-8e2c-4951-929f-3d0609b17b7c tempest-VolumesListAdminTestJSON-807627094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5ef92bd6-8e2c-4951-929f-3d0609b17b7c tempest-VolumesListAdminTestJSON-807627094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5ef92bd6-8e2c-4951-929f-3d0609b17b7c tempest-VolumesListAdminTestJSON-807627094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:01:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5ef92bd6-8e2c-4951-929f-3d0609b17b7c tempest-VolumesListAdminTestJSON-807627094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:01:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5ef92bd6-8e2c-4951-929f-3d0609b17b7c tempest-VolumesListAdminTestJSON-807627094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5ef92bd6-8e2c-4951-929f-3d0609b17b7c tempest-VolumesListAdminTestJSON-807627094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-73859707-a60d-4119-b561-dc6353c17172 tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237 1G" returned: 0 in 1.176s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-73859707-a60d-4119-b561-dc6353c17172 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c120577e-ef1c-488a-8bbd-43600e261979 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:19 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:01:19 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:19 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c120577e-ef1c-488a-8bbd-43600e261979 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237 Jul 07 22:01:19 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d09c0097-9bbb-4d9f-ac63-7664a29c93df tempest-VolumesListAdminTestJSON-807627094 None] Acquiring lock "cinder-5a4fb997-dab5-45c7-8723-d83b2e2ff6ed-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d09c0097-9bbb-4d9f-ac63-7664a29c93df tempest-VolumesListAdminTestJSON-807627094 None] Lock "cinder-5a4fb997-dab5-45c7-8723-d83b2e2ff6ed-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d09c0097-9bbb-4d9f-ac63-7664a29c93df tempest-VolumesListAdminTestJSON-807627094 None] Acquiring lock "cinder-quobyte-5a4fb997-dab5-45c7-8723-d83b2e2ff6ed" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d09c0097-9bbb-4d9f-ac63-7664a29c93df tempest-VolumesListAdminTestJSON-807627094 None] Lock "cinder-quobyte-5a4fb997-dab5-45c7-8723-d83b2e2ff6ed" acquired by "delete_volume" :: waited 0.018s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:19 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[276e6209-2962-4192-bdbf-1a72382ad9e3]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:01:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d09c0097-9bbb-4d9f-ac63-7664a29c93df tempest-VolumesListAdminTestJSON-807627094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a4fb997-dab5-45c7-8723-d83b2e2ff6ed {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:20 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a4fb997-dab5-45c7-8723-d83b2e2ff6ed Jul 07 22:01:20 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:20 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5ef92bd6-8e2c-4951-929f-3d0609b17b7c tempest-VolumesListAdminTestJSON-807627094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.698s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:20 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-5ef92bd6-8e2c-4951-929f-3d0609b17b7c tempest-VolumesListAdminTestJSON-807627094 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:01:20 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-5ef92bd6-8e2c-4951-929f-3d0609b17b7c tempest-VolumesListAdminTestJSON-807627094 None] Deleted volume successfully. Jul 07 22:01:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5ef92bd6-8e2c-4951-929f-3d0609b17b7c tempest-VolumesListAdminTestJSON-807627094 None] Lock "cinder-ac3b15c5-c4f3-44c7-990e-1dfe5daaf36b-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:01:20 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-73859707-a60d-4119-b561-dc6353c17172 tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c120577e-ef1c-488a-8bbd-43600e261979 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237" returned: 0 in 0.825s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:20 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-73859707-a60d-4119-b561-dc6353c17172 tempest-VolumesDeleteCascade-1260294996 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237 is being set with open permissions: ugo+rw Jul 07 22:01:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-73859707-a60d-4119-b561-dc6353c17172 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:20 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237 Jul 07 22:01:20 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:20 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d09c0097-9bbb-4d9f-ac63-7664a29c93df tempest-VolumesListAdminTestJSON-807627094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a4fb997-dab5-45c7-8723-d83b2e2ff6ed" returned: 0 in 0.847s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d09c0097-9bbb-4d9f-ac63-7664a29c93df tempest-VolumesListAdminTestJSON-807627094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a4fb997-dab5-45c7-8723-d83b2e2ff6ed {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:20 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a4fb997-dab5-45c7-8723-d83b2e2ff6ed Jul 07 22:01:20 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:21 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-73859707-a60d-4119-b561-dc6353c17172 tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237" returned: 0 in 0.738s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-73859707-a60d-4119-b561-dc6353c17172 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:21 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.info Jul 07 22:01:21 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:21 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d09c0097-9bbb-4d9f-ac63-7664a29c93df tempest-VolumesListAdminTestJSON-807627094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a4fb997-dab5-45c7-8723-d83b2e2ff6ed" returned: 0 in 0.740s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:21 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d09c0097-9bbb-4d9f-ac63-7664a29c93df tempest-VolumesListAdminTestJSON-807627094 None] Lock "cinder-quobyte-5a4fb997-dab5-45c7-8723-d83b2e2ff6ed" released by "delete_volume" :: held 1.642s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:01:21 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-d09c0097-9bbb-4d9f-ac63-7664a29c93df tempest-VolumesListAdminTestJSON-807627094 None] Created reservations ['56d7eede-5d82-4db5-8fb0-5e682e5dc413', '26a3c645-c067-45e5-923d-d1ad68b88ee6', '663f499e-259f-48e9-97ea-53db9c787384', 'd028174d-34d6-4566-a5e1-0d68ded2ab29'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:01:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d09c0097-9bbb-4d9f-ac63-7664a29c93df tempest-VolumesListAdminTestJSON-807627094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d09c0097-9bbb-4d9f-ac63-7664a29c93df tempest-VolumesListAdminTestJSON-807627094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d09c0097-9bbb-4d9f-ac63-7664a29c93df tempest-VolumesListAdminTestJSON-807627094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:01:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d09c0097-9bbb-4d9f-ac63-7664a29c93df tempest-VolumesListAdminTestJSON-807627094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:01:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d09c0097-9bbb-4d9f-ac63-7664a29c93df tempest-VolumesListAdminTestJSON-807627094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d09c0097-9bbb-4d9f-ac63-7664a29c93df tempest-VolumesListAdminTestJSON-807627094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:21 devstack sudo[97114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:01:21 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:21 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-73859707-a60d-4119-b561-dc6353c17172 tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.info" returned: 0 in 0.718s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:21 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-73859707-a60d-4119-b561-dc6353c17172 tempest-VolumesDeleteCascade-1260294996 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.info is being set with open permissions: ugo+rw Jul 07 22:01:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-73859707-a60d-4119-b561-dc6353c17172 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:21 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.info Jul 07 22:01:21 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-890a8e0a-00e9-401d-a533-b99f8d397b0f tempest-VolumesActionsTest-1681444817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:22 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d09c0097-9bbb-4d9f-ac63-7664a29c93df tempest-VolumesListAdminTestJSON-807627094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.787s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:22 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-d09c0097-9bbb-4d9f-ac63-7664a29c93df tempest-VolumesListAdminTestJSON-807627094 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:01:22 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d09c0097-9bbb-4d9f-ac63-7664a29c93df tempest-VolumesListAdminTestJSON-807627094 None] Deleted volume successfully. Jul 07 22:01:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d09c0097-9bbb-4d9f-ac63-7664a29c93df tempest-VolumesListAdminTestJSON-807627094 None] Lock "cinder-5a4fb997-dab5-45c7-8723-d83b2e2ff6ed-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:01:22 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-73859707-a60d-4119-b561-dc6353c17172 tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.info" returned: 0 in 0.724s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-73859707-a60d-4119-b561-dc6353c17172 tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.323s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-890a8e0a-00e9-401d-a533-b99f8d397b0f tempest-VolumesActionsTest-1681444817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.224s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:22 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d677ff7f-c271-4297-8f6b-165d92745d46]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:01:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-890a8e0a-00e9-401d-a533-b99f8d397b0f tempest-VolumesActionsTest-1681444817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:22 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-73859707-a60d-4119-b561-dc6353c17172 tempest-VolumesDeleteCascade-1260294996 None] Create snapshot completed successfully Jul 07 22:01:22 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 Jul 07 22:01:22 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:23 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-890a8e0a-00e9-401d-a533-b99f8d397b0f tempest-VolumesActionsTest-1681444817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74" returned: 0 in 0.843s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:23 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d00290-8a0e-464e-aeaf-915cda13400a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:01:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-890a8e0a-00e9-401d-a533-b99f8d397b0f tempest-VolumesActionsTest-1681444817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:23 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 Jul 07 22:01:23 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e3345dc9-36ea-4f45-89df-48df50cec6a2 tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:24 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-890a8e0a-00e9-401d-a533-b99f8d397b0f tempest-VolumesActionsTest-1681444817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74" returned: 0 in 0.922s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-890a8e0a-00e9-401d-a533-b99f8d397b0f tempest-VolumesActionsTest-1681444817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 /opt/stack/data/cinder/conversion/4d558151-640e-418e-8087-04c49d158e74.temp_image.c114a96e-8082-476b-9d1a-a356bd98ef85njhp8qdi.img {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:24 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 /opt/stack/data/cinder/conversion/4d558151-640e-418e-8087-04c49d158e74.temp_image.c114a96e-8082-476b-9d1a-a356bd98ef85njhp8qdi.img Jul 07 22:01:24 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-56abe84c-0290-4f5f-9915-305273d151cd tempest-AttachVolumeNegativeTest-648165259 None] Acquiring lock "cinder-ff471ef3-fdd1-430d-a03d-956b364eacfc-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-56abe84c-0290-4f5f-9915-305273d151cd tempest-AttachVolumeNegativeTest-648165259 None] Lock "cinder-ff471ef3-fdd1-430d-a03d-956b364eacfc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-56abe84c-0290-4f5f-9915-305273d151cd tempest-AttachVolumeNegativeTest-648165259 None] Acquiring lock "cinder-quobyte-ff471ef3-fdd1-430d-a03d-956b364eacfc" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-56abe84c-0290-4f5f-9915-305273d151cd tempest-AttachVolumeNegativeTest-648165259 None] Lock "cinder-quobyte-ff471ef3-fdd1-430d-a03d-956b364eacfc" acquired by "delete_volume" :: waited 0.014s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:25 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6bbac0-185d-44e6-8642-f5e2687ba0d4]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:01:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56abe84c-0290-4f5f-9915-305273d151cd tempest-AttachVolumeNegativeTest-648165259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ff471ef3-fdd1-430d-a03d-956b364eacfc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:25 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ff471ef3-fdd1-430d-a03d-956b364eacfc Jul 07 22:01:25 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:26 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56abe84c-0290-4f5f-9915-305273d151cd tempest-AttachVolumeNegativeTest-648165259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ff471ef3-fdd1-430d-a03d-956b364eacfc" returned: 0 in 1.402s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56abe84c-0290-4f5f-9915-305273d151cd tempest-AttachVolumeNegativeTest-648165259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ff471ef3-fdd1-430d-a03d-956b364eacfc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:26 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ff471ef3-fdd1-430d-a03d-956b364eacfc Jul 07 22:01:26 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:28 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56abe84c-0290-4f5f-9915-305273d151cd tempest-AttachVolumeNegativeTest-648165259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ff471ef3-fdd1-430d-a03d-956b364eacfc" returned: 0 in 1.551s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-56abe84c-0290-4f5f-9915-305273d151cd tempest-AttachVolumeNegativeTest-648165259 None] Lock "cinder-quobyte-ff471ef3-fdd1-430d-a03d-956b364eacfc" released by "delete_volume" :: held 3.024s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:01:28 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-56abe84c-0290-4f5f-9915-305273d151cd tempest-AttachVolumeNegativeTest-648165259 None] Created reservations ['50ab2ce2-6fd4-4e7b-9cf6-3a4a09f33c97', 'e3367ca6-ae7a-48e1-a6b9-1ea0d65e63fd', '66fb8af2-5828-41b2-9098-bb97a51074d6', '5d243efe-790f-40e8-9d3c-1f745341e056'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:01:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-56abe84c-0290-4f5f-9915-305273d151cd tempest-AttachVolumeNegativeTest-648165259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-56abe84c-0290-4f5f-9915-305273d151cd tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-56abe84c-0290-4f5f-9915-305273d151cd tempest-AttachVolumeNegativeTest-648165259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:01:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-56abe84c-0290-4f5f-9915-305273d151cd tempest-AttachVolumeNegativeTest-648165259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:01:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-56abe84c-0290-4f5f-9915-305273d151cd tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56abe84c-0290-4f5f-9915-305273d151cd tempest-AttachVolumeNegativeTest-648165259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:28 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:01:28 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4359a083-3b20-4e8f-94b8-891508a8b5f5 tempest-AttachVolumeNegativeTest-648165259 None] Acquiring lock "cinder-8167e04c-2e5d-4900-a26b-0464e0004a63-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4359a083-3b20-4e8f-94b8-891508a8b5f5 tempest-AttachVolumeNegativeTest-648165259 None] Lock "cinder-8167e04c-2e5d-4900-a26b-0464e0004a63-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4359a083-3b20-4e8f-94b8-891508a8b5f5 tempest-AttachVolumeNegativeTest-648165259 None] Acquiring lock "cinder-quobyte-8167e04c-2e5d-4900-a26b-0464e0004a63" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4359a083-3b20-4e8f-94b8-891508a8b5f5 tempest-AttachVolumeNegativeTest-648165259 None] Lock "cinder-quobyte-8167e04c-2e5d-4900-a26b-0464e0004a63" acquired by "delete_volume" :: waited 0.034s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:29 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4a0bb6-4cdf-4239-870e-72de4fdd3dd1]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:01:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4359a083-3b20-4e8f-94b8-891508a8b5f5 tempest-AttachVolumeNegativeTest-648165259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8167e04c-2e5d-4900-a26b-0464e0004a63 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:29 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8167e04c-2e5d-4900-a26b-0464e0004a63 Jul 07 22:01:29 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:30 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56abe84c-0290-4f5f-9915-305273d151cd tempest-AttachVolumeNegativeTest-648165259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.876s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:30 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-56abe84c-0290-4f5f-9915-305273d151cd tempest-AttachVolumeNegativeTest-648165259 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:01:30 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-56abe84c-0290-4f5f-9915-305273d151cd tempest-AttachVolumeNegativeTest-648165259 None] Deleted volume successfully. Jul 07 22:01:30 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-56abe84c-0290-4f5f-9915-305273d151cd tempest-AttachVolumeNegativeTest-648165259 None] Lock "cinder-ff471ef3-fdd1-430d-a03d-956b364eacfc-delete_volume" released by "delete_volume" :: held 5.442s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:01:30 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-890a8e0a-00e9-401d-a533-b99f8d397b0f tempest-VolumesActionsTest-1681444817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 /opt/stack/data/cinder/conversion/4d558151-640e-418e-8087-04c49d158e74.temp_image.c114a96e-8082-476b-9d1a-a356bd98ef85njhp8qdi.img" returned: 0 in 6.076s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:30 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[36727c49-e1e7-43ad-a72d-df0cbdef03fd]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:01:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-890a8e0a-00e9-401d-a533-b99f8d397b0f tempest-VolumesActionsTest-1681444817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:30 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 Jul 07 22:01:30 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:30 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4359a083-3b20-4e8f-94b8-891508a8b5f5 tempest-AttachVolumeNegativeTest-648165259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8167e04c-2e5d-4900-a26b-0464e0004a63" returned: 0 in 1.340s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4359a083-3b20-4e8f-94b8-891508a8b5f5 tempest-AttachVolumeNegativeTest-648165259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8167e04c-2e5d-4900-a26b-0464e0004a63 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:30 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8167e04c-2e5d-4900-a26b-0464e0004a63 Jul 07 22:01:30 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:31 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-890a8e0a-00e9-401d-a533-b99f8d397b0f tempest-VolumesActionsTest-1681444817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74" returned: 0 in 1.066s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:31 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-890a8e0a-00e9-401d-a533-b99f8d397b0f tempest-VolumesActionsTest-1681444817 None] Image conversion details: src /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74, size 1024.00 MB, duration 6.08 sec, destination /opt/stack/data/cinder/conversion/4d558151-640e-418e-8087-04c49d158e74.temp_image.c114a96e-8082-476b-9d1a-a356bd98ef85njhp8qdi.img {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:01:31 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-890a8e0a-00e9-401d-a533-b99f8d397b0f tempest-VolumesActionsTest-1681444817 None] Converted 1024.00 MB image at 168.51 MB/s Jul 07 22:01:31 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-890a8e0a-00e9-401d-a533-b99f8d397b0f tempest-VolumesActionsTest-1681444817 None] c114a96e-8082-476b-9d1a-a356bd98ef85 was raw, no need to convert to raw {{(pid=87586) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 07 22:01:31 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4359a083-3b20-4e8f-94b8-891508a8b5f5 tempest-AttachVolumeNegativeTest-648165259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8167e04c-2e5d-4900-a26b-0464e0004a63" returned: 0 in 0.776s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4359a083-3b20-4e8f-94b8-891508a8b5f5 tempest-AttachVolumeNegativeTest-648165259 None] Lock "cinder-quobyte-8167e04c-2e5d-4900-a26b-0464e0004a63" released by "delete_volume" :: held 2.222s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:01:31 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-4359a083-3b20-4e8f-94b8-891508a8b5f5 tempest-AttachVolumeNegativeTest-648165259 None] Created reservations ['a00f7d83-f676-4389-91a6-8adf52e0ead6', '939deee3-156b-46f3-ba9d-8976f0b801f7', 'd7f91618-6694-486c-b466-e97975961c72', 'eb49f719-1520-48ad-a2a7-b2de82b6d730'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:01:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4359a083-3b20-4e8f-94b8-891508a8b5f5 tempest-AttachVolumeNegativeTest-648165259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4359a083-3b20-4e8f-94b8-891508a8b5f5 tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4359a083-3b20-4e8f-94b8-891508a8b5f5 tempest-AttachVolumeNegativeTest-648165259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:01:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4359a083-3b20-4e8f-94b8-891508a8b5f5 tempest-AttachVolumeNegativeTest-648165259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:01:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4359a083-3b20-4e8f-94b8-891508a8b5f5 tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4359a083-3b20-4e8f-94b8-891508a8b5f5 tempest-AttachVolumeNegativeTest-648165259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:31 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:01:31 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:32 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4359a083-3b20-4e8f-94b8-891508a8b5f5 tempest-AttachVolumeNegativeTest-648165259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.810s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:32 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-4359a083-3b20-4e8f-94b8-891508a8b5f5 tempest-AttachVolumeNegativeTest-648165259 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:01:32 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-4359a083-3b20-4e8f-94b8-891508a8b5f5 tempest-AttachVolumeNegativeTest-648165259 None] Deleted volume successfully. Jul 07 22:01:32 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4359a083-3b20-4e8f-94b8-891508a8b5f5 tempest-AttachVolumeNegativeTest-648165259 None] Lock "cinder-8167e04c-2e5d-4900-a26b-0464e0004a63-delete_volume" released by "delete_volume" :: held 3.369s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:01:32 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9126d090-e1ea-4e01-998f-a75f29fb6ba1 tempest-AttachVolumeNegativeTest-648165259 None] Acquiring lock "cinder-cca1b150-6671-4b07-aa58-75455ee079b1-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:32 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9126d090-e1ea-4e01-998f-a75f29fb6ba1 tempest-AttachVolumeNegativeTest-648165259 None] Lock "cinder-cca1b150-6671-4b07-aa58-75455ee079b1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:32 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9126d090-e1ea-4e01-998f-a75f29fb6ba1 tempest-AttachVolumeNegativeTest-648165259 None] Acquiring lock "cinder-quobyte-cca1b150-6671-4b07-aa58-75455ee079b1" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:32 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9126d090-e1ea-4e01-998f-a75f29fb6ba1 tempest-AttachVolumeNegativeTest-648165259 None] Lock "cinder-quobyte-cca1b150-6671-4b07-aa58-75455ee079b1" acquired by "delete_volume" :: waited 0.025s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:33 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[849d53aa-fc95-4f5e-b6d3-c06dcb981f8f]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:01:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9126d090-e1ea-4e01-998f-a75f29fb6ba1 tempest-AttachVolumeNegativeTest-648165259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-cca1b150-6671-4b07-aa58-75455ee079b1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:33 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-cca1b150-6671-4b07-aa58-75455ee079b1 Jul 07 22:01:33 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:33 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9126d090-e1ea-4e01-998f-a75f29fb6ba1 tempest-AttachVolumeNegativeTest-648165259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-cca1b150-6671-4b07-aa58-75455ee079b1" returned: 0 in 0.881s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9126d090-e1ea-4e01-998f-a75f29fb6ba1 tempest-AttachVolumeNegativeTest-648165259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-cca1b150-6671-4b07-aa58-75455ee079b1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:33 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-cca1b150-6671-4b07-aa58-75455ee079b1 Jul 07 22:01:33 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:34 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9126d090-e1ea-4e01-998f-a75f29fb6ba1 tempest-AttachVolumeNegativeTest-648165259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-cca1b150-6671-4b07-aa58-75455ee079b1" returned: 0 in 0.831s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9126d090-e1ea-4e01-998f-a75f29fb6ba1 tempest-AttachVolumeNegativeTest-648165259 None] Lock "cinder-quobyte-cca1b150-6671-4b07-aa58-75455ee079b1" released by "delete_volume" :: held 1.772s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:01:34 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:01:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Flow 'volume_create_manager' (0b45ef32-ae64-47ca-8503-571fbfa9bdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:01:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b7d748-2627-4aee-bf69-bf1758723cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b7d748-2627-4aee-bf69-bf1758723cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1163663794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a20ed3-6ada-4ec4-99c5-fa20a34d5d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0788f7c19c46788e78cd76ecd17584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:01:35Z,use_quota=True,user_id='b444435f111949edb1b337082027c184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29bb9a5-df63-4062-9b38-8cb67d5b671a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29bb9a5-df63-4062-9b38-8cb67d5b671a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac52f01b-be9e-4aa1-95fb-4b552911d6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac52f01b-be9e-4aa1-95fb-4b552911d6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63a20ed3-6ada-4ec4-99c5-fa20a34d5d29', 'volume_name': 'volume-63a20ed3-6ada-4ec4-99c5-fa20a34d5d29', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a9dcd1c-ab33-4c08-b619-2a35c3db2ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a9dcd1c-ab33-4c08-b619-2a35c3db2ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816e2aeb-dd59-49da-8e66-a12d01b8db6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:34 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Volume 63a20ed3-6ada-4ec4-99c5-fa20a34d5d29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63a20ed3-6ada-4ec4-99c5-fa20a34d5d29', 'volume_size': 1} Jul 07 22:01:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:34 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-9126d090-e1ea-4e01-998f-a75f29fb6ba1 tempest-AttachVolumeNegativeTest-648165259 None] Created reservations ['1857a7ec-a215-4e40-b0d0-f8eafc7decf9', '20571e71-84bd-4f84-8d8c-d8311231930f', 'ca72dd3a-2e67-4f8f-ad45-0df06d4ace2d', '2c4d996b-7e35-4f79-9bb2-cd0018143f0b'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:01:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9126d090-e1ea-4e01-998f-a75f29fb6ba1 tempest-AttachVolumeNegativeTest-648165259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9126d090-e1ea-4e01-998f-a75f29fb6ba1 tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9126d090-e1ea-4e01-998f-a75f29fb6ba1 tempest-AttachVolumeNegativeTest-648165259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:01:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9126d090-e1ea-4e01-998f-a75f29fb6ba1 tempest-AttachVolumeNegativeTest-648165259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:01:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9126d090-e1ea-4e01-998f-a75f29fb6ba1 tempest-AttachVolumeNegativeTest-648165259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9126d090-e1ea-4e01-998f-a75f29fb6ba1 tempest-AttachVolumeNegativeTest-648165259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:35 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:01:35 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:01:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:01:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:01:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:35 devstack sudo[97244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:01:35 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:35 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9126d090-e1ea-4e01-998f-a75f29fb6ba1 tempest-AttachVolumeNegativeTest-648165259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.874s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:35 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-9126d090-e1ea-4e01-998f-a75f29fb6ba1 tempest-AttachVolumeNegativeTest-648165259 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:01:35 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-9126d090-e1ea-4e01-998f-a75f29fb6ba1 tempest-AttachVolumeNegativeTest-648165259 None] Deleted volume successfully. Jul 07 22:01:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9126d090-e1ea-4e01-998f-a75f29fb6ba1 tempest-AttachVolumeNegativeTest-648165259 None] Lock "cinder-cca1b150-6671-4b07-aa58-75455ee079b1-delete_volume" released by "delete_volume" :: held 3.102s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:01:36 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.948s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:01:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:01:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 28 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 22:01:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 22:01:43 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=99,cinder:UPDATE=124,cinder:INSERT=22,cinder:DELETE=9 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:01:43 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:INSERT=32,cinder:SELECT=109,cinder:UPDATE=113,cinder:DELETE=10 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:01:43 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:01:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Flow 'volume_create_manager' (fb078ff0-21fc-4410-b12d-b8030620fc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:01:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfd9eaa-2bb4-424e-b6bd-cd7b979ec9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfd9eaa-2bb4-424e-b6bd-cd7b979ec9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1896146935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ceae82f-5a71-41d3-8977-fd82c8d9a5fd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2de8c93af00745608b325c66f2e84a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:01:44Z,use_quota=True,user_id='50e75657b0c9434983556651a2c3a81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169a20ef-61fc-4717-8e84-3768da325204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169a20ef-61fc-4717-8e84-3768da325204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59b31d2-9033-4192-b92a-6d91b6672986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59b31d2-9033-4192-b92a-6d91b6672986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ceae82f-5a71-41d3-8977-fd82c8d9a5fd', 'volume_name': 'volume-5ceae82f-5a71-41d3-8977-fd82c8d9a5fd', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49cc984-a804-4b3c-819d-49447d7040e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49cc984-a804-4b3c-819d-49447d7040e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1603ed6a-d49a-4a4e-9ab7-6bb8f213b15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:43 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Volume 5ceae82f-5a71-41d3-8977-fd82c8d9a5fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ceae82f-5a71-41d3-8977-fd82c8d9a5fd', 'volume_size': 1} Jul 07 22:01:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-890a8e0a-00e9-401d-a533-b99f8d397b0f tempest-VolumesActionsTest-1681444817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.618s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-890a8e0a-00e9-401d-a533-b99f8d397b0f tempest-VolumesActionsTest-1681444817 None] Uploaded volume to glance image-id: c114a96e-8082-476b-9d1a-a356bd98ef85. {{(pid=87586) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 22:01:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e3345dc9-36ea-4f45-89df-48df50cec6a2 tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 28.454s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-e3345dc9-36ea-4f45-89df-48df50cec6a2 tempest-VolumesDeleteCascade-1260294996 None] Creating offline snapshot e1b2ea33-b164-4d68-9688-0a98c0a5b45f of volume c120577e-ef1c-488a-8bbd-43600e261979 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:01:52 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-890a8e0a-00e9-401d-a533-b99f8d397b0f tempest-VolumesActionsTest-1681444817 None] Copy volume to image completed successfully. Jul 07 22:01:52 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8650c859-1614-4585-9a56-9138526341b5]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:01:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e3345dc9-36ea-4f45-89df-48df50cec6a2 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:52 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237 Jul 07 22:01:52 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:53 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e3345dc9-36ea-4f45-89df-48df50cec6a2 tempest-VolumesDeleteCascade-1260294996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237" returned: 0 in 0.772s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:53 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-e3345dc9-36ea-4f45-89df-48df50cec6a2 tempest-VolumesDeleteCascade-1260294996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c120577e-ef1c-488a-8bbd-43600e261979(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:01:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e3345dc9-36ea-4f45-89df-48df50cec6a2 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:53 devstack sudo[97261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f 1G Jul 07 22:01:53 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:53 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e3345dc9-36ea-4f45-89df-48df50cec6a2 tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f 1G" returned: 0 in 0.840s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e3345dc9-36ea-4f45-89df-48df50cec6a2 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:53 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f Jul 07 22:01:53 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:54 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e3345dc9-36ea-4f45-89df-48df50cec6a2 tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f" returned: 0 in 0.668s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:54 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-e3345dc9-36ea-4f45-89df-48df50cec6a2 tempest-VolumesDeleteCascade-1260294996 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f is being set with open permissions: ugo+rw Jul 07 22:01:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e3345dc9-36ea-4f45-89df-48df50cec6a2 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:54 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f Jul 07 22:01:54 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:55 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e3345dc9-36ea-4f45-89df-48df50cec6a2 tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f" returned: 0 in 0.609s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e3345dc9-36ea-4f45-89df-48df50cec6a2 tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.992s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.271s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1163663794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a20ed3-6ada-4ec4-99c5-fa20a34d5d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0788f7c19c46788e78cd76ecd17584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:01:35Z,use_quota=True,user_id='b444435f111949edb1b337082027c184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Creating volume 63a20ed3-6ada-4ec4-99c5-fa20a34d5d29 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:01:55 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-63a20ed3-6ada-4ec4-99c5-fa20a34d5d29 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:55 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-63a20ed3-6ada-4ec4-99c5-fa20a34d5d29 1073741824 Jul 07 22:01:55 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:55 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-e3345dc9-36ea-4f45-89df-48df50cec6a2 tempest-VolumesDeleteCascade-1260294996 None] Create snapshot completed successfully Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "cinder-c120577e-ef1c-488a-8bbd-43600e261979-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-c120577e-ef1c-488a-8bbd-43600e261979-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Performing cascade delete. {{(pid=87586) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "cinder-206d4bdc-824b-4a62-82d2-5e03c3a12237-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-206d4bdc-824b-4a62-82d2-5e03c3a12237-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "cinder-quobyte-c120577e-ef1c-488a-8bbd-43600e261979" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-quobyte-c120577e-ef1c-488a-8bbd-43600e261979" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "cinder-quobyte-206d4bdc-824b-4a62-82d2-5e03c3a12237" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-quobyte-206d4bdc-824b-4a62-82d2-5e03c3a12237" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Deleting offline snapshot 206d4bdc-824b-4a62-82d2-5e03c3a12237 of volume c120577e-ef1c-488a-8bbd-43600e261979 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] snapshot_file for this snap is: volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[122b5583-8a2b-492f-b548-a214626d0505]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:01:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:55 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237 Jul 07 22:01:55 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:56 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-63a20ed3-6ada-4ec4-99c5-fa20a34d5d29 1073741824" returned: 0 in 0.821s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-63a20ed3-6ada-4ec4-99c5-fa20a34d5d29 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:56 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-63a20ed3-6ada-4ec4-99c5-fa20a34d5d29 Jul 07 22:01:56 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:56 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237" returned: 0 in 0.779s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c120577e-ef1c-488a-8bbd-43600e261979(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b808e6-fd68-4ca7-b175-8d356467767a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:56 devstack sudo[97287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979 Jul 07 22:01:56 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:56 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-63a20ed3-6ada-4ec4-99c5-fa20a34d5d29" returned: 0 in 0.634s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.846s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1896146935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ceae82f-5a71-41d3-8977-fd82c8d9a5fd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2de8c93af00745608b325c66f2e84a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:01:44Z,use_quota=True,user_id='50e75657b0c9434983556651a2c3a81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Creating volume 5ceae82f-5a71-41d3-8977-fd82c8d9a5fd {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:01:56 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ceae82f-5a71-41d3-8977-fd82c8d9a5fd 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:56 devstack sudo[97290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ceae82f-5a71-41d3-8977-fd82c8d9a5fd 1073741824 Jul 07 22:01:56 devstack sudo[97290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816e2aeb-dd59-49da-8e66-a12d01b8db6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63a20ed3-6ada-4ec4-99c5-fa20a34d5d29', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399f5065-3bcf-4bae-83a2-d2d09cc180c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:56 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Volume volume-63a20ed3-6ada-4ec4-99c5-fa20a34d5d29 (63a20ed3-6ada-4ec4-99c5-fa20a34d5d29): created successfully Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399f5065-3bcf-4bae-83a2-d2d09cc180c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Flow 'volume_create_manager' (0b45ef32-ae64-47ca-8503-571fbfa9bdbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:01:56 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-83fbd957-6f80-4ec3-b76e-c8407b494613 tempest-VolumesTransfersV357Test-340832584 None] Created volume successfully. Jul 07 22:01:57 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979" returned: 0 in 0.775s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:57 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee3f474-88ec-458e-a119-eb16ebbd4bb4]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:01:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:57 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f Jul 07 22:01:57 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:57 devstack sudo[97290]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ceae82f-5a71-41d3-8977-fd82c8d9a5fd 1073741824" returned: 0 in 0.948s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ceae82f-5a71-41d3-8977-fd82c8d9a5fd {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:57 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ceae82f-5a71-41d3-8977-fd82c8d9a5fd Jul 07 22:01:57 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:57 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-0b821e55-59ee-49e6-b696-d24dc0257e79 tempest-VolumesTransfersV357Test-360071344 None] Transfer volume completed successfully. Jul 07 22:01:58 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f" returned: 0 in 0.823s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c120577e-ef1c-488a-8bbd-43600e261979(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:01:58 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df1df49-0b7f-45a8-9643-2137d2f7a79b]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:01:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:58 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237 Jul 07 22:01:58 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:58 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ceae82f-5a71-41d3-8977-fd82c8d9a5fd" returned: 0 in 0.670s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:01:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:01:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 4.738s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:01:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1603ed6a-d49a-4a4e-9ab7-6bb8f213b15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ceae82f-5a71-41d3-8977-fd82c8d9a5fd', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd644f4f-be59-40b9-85c6-e1e254a87afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:58 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c968da2b-9bd5-48ac-9573-6b97998ed5ae]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:01:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:58 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Volume volume-5ceae82f-5a71-41d3-8977-fd82c8d9a5fd (5ceae82f-5a71-41d3-8977-fd82c8d9a5fd): created successfully Jul 07 22:01:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd644f4f-be59-40b9-85c6-e1e254a87afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Flow 'volume_create_manager' (fb078ff0-21fc-4410-b12d-b8030620fc08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:01:58 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6a1af691-581f-4264-bce0-784ab44dedd5 tempest-VolumesTestJSON-2027793842 None] Created volume successfully. Jul 07 22:01:58 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 Jul 07 22:01:58 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:58 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237" returned: 0 in 0.876s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c120577e-ef1c-488a-8bbd-43600e261979(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:01:58 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0932fe80-cce3-401b-930a-1418b4f2849a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:01:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:59 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979 Jul 07 22:01:59 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ae402dc9-e77b-4320-ae0c-6892b6bd718d tempest-VolumesTransfersV357Test-1678212061 None] Acquiring lock "cinder-63a20ed3-6ada-4ec4-99c5-fa20a34d5d29-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ae402dc9-e77b-4320-ae0c-6892b6bd718d tempest-VolumesTransfersV357Test-1678212061 None] Lock "cinder-63a20ed3-6ada-4ec4-99c5-fa20a34d5d29-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ae402dc9-e77b-4320-ae0c-6892b6bd718d tempest-VolumesTransfersV357Test-1678212061 None] Acquiring lock "cinder-quobyte-63a20ed3-6ada-4ec4-99c5-fa20a34d5d29" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ae402dc9-e77b-4320-ae0c-6892b6bd718d tempest-VolumesTransfersV357Test-1678212061 None] Lock "cinder-quobyte-63a20ed3-6ada-4ec4-99c5-fa20a34d5d29" acquired by "delete_volume" :: waited 0.029s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[577ee4f7-d8bd-4126-a5db-29d832299004]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ae402dc9-e77b-4320-ae0c-6892b6bd718d tempest-VolumesTransfersV357Test-1678212061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-63a20ed3-6ada-4ec4-99c5-fa20a34d5d29 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:59 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74" returned: 0 in 0.935s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd320f85-fa7b-4f2e-a80a-2294e880001b]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:59 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-63a20ed3-6ada-4ec4-99c5-fa20a34d5d29 Jul 07 22:01:59 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:59 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 Jul 07 22:01:59 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Flow 'volume_create_manager' (430baa2e-8290-4c70-9410-423189258035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c84e23c-2ba1-4312-b6c8-230b80b8f84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c84e23c-2ba1-4312-b6c8-230b80b8f84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-683634694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d84c236-7e34-4576-ace4-c36e4d1faee8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2de8c93af00745608b325c66f2e84a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:01:59Z,use_quota=True,user_id='50e75657b0c9434983556651a2c3a81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63e8c39-52cf-49eb-af58-7f88cbfe04b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63e8c39-52cf-49eb-af58-7f88cbfe04b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5310b480-6057-4ada-aba7-f98b232ce597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5310b480-6057-4ada-aba7-f98b232ce597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d84c236-7e34-4576-ace4-c36e4d1faee8', 'volume_name': 'volume-9d84c236-7e34-4576-ace4-c36e4d1faee8', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934f193c-01bb-4cff-beaf-b36dfc6e4856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934f193c-01bb-4cff-beaf-b36dfc6e4856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b330cd-ea12-4364-a29b-1735d47123fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:01:59 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Volume 9d84c236-7e34-4576-ace4-c36e4d1faee8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d84c236-7e34-4576-ace4-c36e4d1faee8', 'volume_size': 1} Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:01:59 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979" returned: 0 in 0.940s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:01:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:01:59 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237 Jul 07 22:01:59 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:00 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ae402dc9-e77b-4320-ae0c-6892b6bd718d tempest-VolumesTransfersV357Test-1678212061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-63a20ed3-6ada-4ec4-99c5-fa20a34d5d29" returned: 0 in 0.849s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ae402dc9-e77b-4320-ae0c-6892b6bd718d tempest-VolumesTransfersV357Test-1678212061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-63a20ed3-6ada-4ec4-99c5-fa20a34d5d29 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:00 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-63a20ed3-6ada-4ec4-99c5-fa20a34d5d29 Jul 07 22:02:00 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:00 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74" returned: 0 in 0.801s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 /opt/stack/data/cinder/conversion/4d558151-640e-418e-8087-04c49d158e74.temp_image.a7423e75-62f2-433d-8a62-bc0e0d1d65a0p0yqnqns.img {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:00 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 /opt/stack/data/cinder/conversion/4d558151-640e-418e-8087-04c49d158e74.temp_image.a7423e75-62f2-433d-8a62-bc0e0d1d65a0p0yqnqns.img Jul 07 22:02:00 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:00 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237" returned: 0 in 0.773s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:00 devstack sudo[97342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237 Jul 07 22:02:00 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:00 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ae402dc9-e77b-4320-ae0c-6892b6bd718d tempest-VolumesTransfersV357Test-1678212061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-63a20ed3-6ada-4ec4-99c5-fa20a34d5d29" returned: 0 in 0.710s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:00 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ae402dc9-e77b-4320-ae0c-6892b6bd718d tempest-VolumesTransfersV357Test-1678212061 None] Lock "cinder-quobyte-63a20ed3-6ada-4ec4-99c5-fa20a34d5d29" released by "delete_volume" :: held 1.648s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:01 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-ae402dc9-e77b-4320-ae0c-6892b6bd718d tempest-VolumesTransfersV357Test-1678212061 None] Created reservations ['49915418-16f0-49ab-a416-e237c92c97fa', '725a77bc-26a9-41b5-95cc-ea86785e5663', '913fb963-f411-4ab9-992e-6dcfdf45bda1', '3eff8f0b-9466-4ac0-8b00-50afb4ad600e'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:02:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ae402dc9-e77b-4320-ae0c-6892b6bd718d tempest-VolumesTransfersV357Test-1678212061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ae402dc9-e77b-4320-ae0c-6892b6bd718d tempest-VolumesTransfersV357Test-1678212061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:01 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ae402dc9-e77b-4320-ae0c-6892b6bd718d tempest-VolumesTransfersV357Test-1678212061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:01 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ae402dc9-e77b-4320-ae0c-6892b6bd718d tempest-VolumesTransfersV357Test-1678212061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ae402dc9-e77b-4320-ae0c-6892b6bd718d tempest-VolumesTransfersV357Test-1678212061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ae402dc9-e77b-4320-ae0c-6892b6bd718d tempest-VolumesTransfersV357Test-1678212061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:01 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:02:01 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:02 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.206d4bdc-824b-4a62-82d2-5e03c3a12237" returned: 0 in 1.564s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c120577e-ef1c-488a-8bbd-43600e261979 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f -F qcow2 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:02 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c120577e-ef1c-488a-8bbd-43600e261979 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f -F qcow2 Jul 07 22:02:02 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:02 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ae402dc9-e77b-4320-ae0c-6892b6bd718d tempest-VolumesTransfersV357Test-1678212061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.395s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:02 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-ae402dc9-e77b-4320-ae0c-6892b6bd718d tempest-VolumesTransfersV357Test-1678212061 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:02:02 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ae402dc9-e77b-4320-ae0c-6892b6bd718d tempest-VolumesTransfersV357Test-1678212061 None] Deleted volume successfully. Jul 07 22:02:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ae402dc9-e77b-4320-ae0c-6892b6bd718d tempest-VolumesTransfersV357Test-1678212061 None] Lock "cinder-63a20ed3-6ada-4ec4-99c5-fa20a34d5d29-delete_volume" released by "delete_volume" :: held 3.566s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:03 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:02:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Flow 'volume_create_manager' (cc87d9c5-042d-4c94-b80e-0c7b6f939ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:02:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e312b8-08af-4aaf-999e-df916e226e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e312b8-08af-4aaf-999e-df916e226e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-39646824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7453e31e-435a-48f0-a8e8-345c450a45f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0788f7c19c46788e78cd76ecd17584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:02:03Z,use_quota=True,user_id='b444435f111949edb1b337082027c184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28603f2b-a742-4654-8d00-77552202a556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28603f2b-a742-4654-8d00-77552202a556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf8a018-9014-4f1d-be7f-aecdcae6b26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf8a018-9014-4f1d-be7f-aecdcae6b26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7453e31e-435a-48f0-a8e8-345c450a45f2', 'volume_name': 'volume-7453e31e-435a-48f0-a8e8-345c450a45f2', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccce852-fbc8-40fa-9182-a9ff59c9397f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccce852-fbc8-40fa-9182-a9ff59c9397f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff2f912-5e6b-4be8-bd46-4bf3c2eff4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:03 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Volume 7453e31e-435a-48f0-a8e8-345c450a45f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7453e31e-435a-48f0-a8e8-345c450a45f2', 'volume_size': 1} Jul 07 22:02:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:03 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c120577e-ef1c-488a-8bbd-43600e261979 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f -F qcow2" returned: 0 in 1.606s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:03 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-quobyte-206d4bdc-824b-4a62-82d2-5e03c3a12237" released by "_delete_snapshot" :: held 8.367s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:03 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-quobyte-c120577e-ef1c-488a-8bbd-43600e261979" released by "delete_snapshot" :: held 8.410s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:04 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Created reservations ['6814dc35-3dce-4a44-b9c8-e41db3400529', '7dc66b21-de8a-451e-93d6-86a3e8a12492', 'ca8a8fb5-4a08-45ff-913d-a72ddd663718', '44acad99-3d20-4bc8-9bfc-4d0c4f451b75'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:02:04 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Delete snapshot completed successfully. Jul 07 22:02:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-206d4bdc-824b-4a62-82d2-5e03c3a12237-delete_snapshot" released by "delete_snapshot" :: held 8.861s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "cinder-e1b2ea33-b164-4d68-9688-0a98c0a5b45f-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-e1b2ea33-b164-4d68-9688-0a98c0a5b45f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "cinder-quobyte-c120577e-ef1c-488a-8bbd-43600e261979" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-quobyte-c120577e-ef1c-488a-8bbd-43600e261979" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "cinder-quobyte-e1b2ea33-b164-4d68-9688-0a98c0a5b45f" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-quobyte-e1b2ea33-b164-4d68-9688-0a98c0a5b45f" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:04 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Deleting offline snapshot e1b2ea33-b164-4d68-9688-0a98c0a5b45f of volume c120577e-ef1c-488a-8bbd-43600e261979 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:02:04 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] snapshot_file for this snap is: volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:02:04 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83a6b0c-2644-44af-ade3-c388b60e2829]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:04 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f Jul 07 22:02:04 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:05 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 /opt/stack/data/cinder/conversion/4d558151-640e-418e-8087-04c49d158e74.temp_image.a7423e75-62f2-433d-8a62-bc0e0d1d65a0p0yqnqns.img" returned: 0 in 5.141s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:05 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e017b99-d375-40d9-8496-036f5c4ef458]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:05 devstack sudo[97368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 Jul 07 22:02:05 devstack sudo[97368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:05 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f" returned: 0 in 1.171s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:05 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c120577e-ef1c-488a-8bbd-43600e261979(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:02:05 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c345d4a0-a429-49c5-a130-e332309896bf]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:05 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979 Jul 07 22:02:05 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:06 devstack sudo[97368]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74" returned: 0 in 0.930s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:06 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] Image conversion details: src /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74, size 1024.00 MB, duration 5.14 sec, destination /opt/stack/data/cinder/conversion/4d558151-640e-418e-8087-04c49d158e74.temp_image.a7423e75-62f2-433d-8a62-bc0e0d1d65a0p0yqnqns.img {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:02:06 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] Converted 1024.00 MB image at 199.13 MB/s Jul 07 22:02:06 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] a7423e75-62f2-433d-8a62-bc0e0d1d65a0 was raw, converting to qcow2 {{(pid=87586) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 07 22:02:06 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[73758e13-462c-4acc-ad24-0db3586c36ae]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4d558151-640e-418e-8087-04c49d158e74.temp_image.a7423e75-62f2-433d-8a62-bc0e0d1d65a0p0yqnqns.img {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:06 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4d558151-640e-418e-8087-04c49d158e74.temp_image.a7423e75-62f2-433d-8a62-bc0e0d1d65a0p0yqnqns.img Jul 07 22:02:06 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:06 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979" returned: 0 in 0.755s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:06 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f Jul 07 22:02:06 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:07 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4d558151-640e-418e-8087-04c49d158e74.temp_image.a7423e75-62f2-433d-8a62-bc0e0d1d65a0p0yqnqns.img" returned: 0 in 0.704s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4d558151-640e-418e-8087-04c49d158e74.temp_image.a7423e75-62f2-433d-8a62-bc0e0d1d65a0p0yqnqns.img {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:07 devstack sudo[97387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4d558151-640e-418e-8087-04c49d158e74.temp_image.a7423e75-62f2-433d-8a62-bc0e0d1d65a0p0yqnqns.img Jul 07 22:02:07 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:07 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f" returned: 0 in 0.794s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:07 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f Jul 07 22:02:07 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:07 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4d558151-640e-418e-8087-04c49d158e74.temp_image.a7423e75-62f2-433d-8a62-bc0e0d1d65a0p0yqnqns.img" returned: 1 in 0.811s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4d558151-640e-418e-8087-04c49d158e74.temp_image.a7423e75-62f2-433d-8a62-bc0e0d1d65a0p0yqnqns.img' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:02:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4d558151-640e-418e-8087-04c49d158e74.temp_image.a7423e75-62f2-433d-8a62-bc0e0d1d65a0p0yqnqns.img /opt/stack/data/cinder/conversion/vol_upload_mve77f3y {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:07 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4d558151-640e-418e-8087-04c49d158e74.temp_image.a7423e75-62f2-433d-8a62-bc0e0d1d65a0p0yqnqns.img /opt/stack/data/cinder/conversion/vol_upload_mve77f3y Jul 07 22:02:07 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:07 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979.e1b2ea33-b164-4d68-9688-0a98c0a5b45f" returned: 0 in 0.635s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-quobyte-e1b2ea33-b164-4d68-9688-0a98c0a5b45f" released by "_delete_snapshot" :: held 3.512s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-quobyte-c120577e-ef1c-488a-8bbd-43600e261979" released by "delete_snapshot" :: held 3.576s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:08 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Created reservations ['52c29429-0aae-4e23-9a74-6a17a463a9bf', 'c95eb0f5-1fca-42a7-a108-a24f84b7bc53', 'c9d633ab-103c-4dae-a7f4-d15d4f4c4ae6', 'ef136605-4c83-43bd-a17a-26ed12dcf94e'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:02:08 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Delete snapshot completed successfully. Jul 07 22:02:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-e1b2ea33-b164-4d68-9688-0a98c0a5b45f-delete_snapshot" released by "delete_snapshot" :: held 3.764s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Snapshots deleted, issuing volume delete {{(pid=87586) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 22:02:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "cinder-quobyte-c120577e-ef1c-488a-8bbd-43600e261979" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-quobyte-c120577e-ef1c-488a-8bbd-43600e261979" acquired by "delete_volume" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:08 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b2a52d-dced-4ef2-9629-ff4fee816de8]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:08 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979 Jul 07 22:02:08 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:08 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4d558151-640e-418e-8087-04c49d158e74.temp_image.a7423e75-62f2-433d-8a62-bc0e0d1d65a0p0yqnqns.img /opt/stack/data/cinder/conversion/vol_upload_mve77f3y" returned: 0 in 0.654s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:08 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] Image conversion details: src /opt/stack/data/cinder/conversion/4d558151-640e-418e-8087-04c49d158e74.temp_image.a7423e75-62f2-433d-8a62-bc0e0d1d65a0p0yqnqns.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_mve77f3y {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:02:08 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 07 22:02:08 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bf9cec-13ac-4b4b-9662-4763fc11b989]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mve77f3y {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:08 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mve77f3y Jul 07 22:02:08 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:08 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979" returned: 0 in 0.750s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:09 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979 Jul 07 22:02:09 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:09 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mve77f3y" returned: 0 in 0.719s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:09 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c120577e-ef1c-488a-8bbd-43600e261979" returned: 0 in 0.648s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:09 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-quobyte-c120577e-ef1c-488a-8bbd-43600e261979" released by "delete_volume" :: held 1.465s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:09 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Created reservations ['0278f421-f105-494a-9c2c-f5a82903e623', 'af9aaffa-2844-4ec4-8882-e5b505e7c8ed', '70dd89c2-4bf8-41bd-8212-ab2aadf1b082', '9481ce0e-5158-4644-a690-719beea6def6'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:02:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:09 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:02:09 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:10 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.630s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:10 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:02:10 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Deleted volume successfully. Jul 07 22:02:10 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54955fbd-1b25-4b96-88c6-53add108963a tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-c120577e-ef1c-488a-8bbd-43600e261979-delete_volume" released by "delete_volume" :: held 14.984s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.230s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] Uploaded volume to glance image-id: a7423e75-62f2-433d-8a62-bc0e0d1d65a0. {{(pid=87586) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 22:02:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.983s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-683634694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d84c236-7e34-4576-ace4-c36e4d1faee8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2de8c93af00745608b325c66f2e84a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:01:59Z,use_quota=True,user_id='50e75657b0c9434983556651a2c3a81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:02:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Creating volume 9d84c236-7e34-4576-ace4-c36e4d1faee8 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:02:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:02:10 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:02:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9d84c236-7e34-4576-ace4-c36e4d1faee8 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:10 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9d84c236-7e34-4576-ace4-c36e4d1faee8 1073741824 Jul 07 22:02:10 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:10 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ba85adc1-3b44-4de6-ba6f-da7557338a62 tempest-VolumesActionsTest-1681444817 None] Copy volume to image completed successfully. Jul 07 22:02:11 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:02:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Flow 'volume_create_manager' (6614ec72-2500-468b-a3c0-1a4b04e33ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:02:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d5a5c1-9eeb-48e8-8cc0-d10a3ac97ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d5a5c1-9eeb-48e8-8cc0-d10a3ac97ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-153011373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4faa1568-b217-4f96-ba56-c0a92f4820da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6ee1d6ac5344cd80816628b6bab90c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:02:11Z,use_quota=True,user_id='0246f35133004d509343ee9e880a798d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19487bc-f3e5-46d6-a57b-9da0ebe06baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19487bc-f3e5-46d6-a57b-9da0ebe06baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd64d4e-fc10-4bfd-9947-72bfb5b1f692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd64d4e-fc10-4bfd-9947-72bfb5b1f692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4faa1568-b217-4f96-ba56-c0a92f4820da', 'volume_name': 'volume-4faa1568-b217-4f96-ba56-c0a92f4820da', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab367f3-36be-4437-8453-4908d2948107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab367f3-36be-4437-8453-4908d2948107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025b4579-4743-48e2-9a26-cb07d5ef792b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:11 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Volume 4faa1568-b217-4f96-ba56-c0a92f4820da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4faa1568-b217-4f96-ba56-c0a92f4820da', 'volume_size': 1} Jul 07 22:02:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:11 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9d84c236-7e34-4576-ace4-c36e4d1faee8 1073741824" returned: 0 in 0.874s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9d84c236-7e34-4576-ace4-c36e4d1faee8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:11 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9d84c236-7e34-4576-ace4-c36e4d1faee8 Jul 07 22:02:11 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-665b39d6-3e4b-4f31-ad39-81b47c6c3397 tempest-VolumesActionsTest-1681444817 None] Acquiring lock "cinder-4d558151-640e-418e-8087-04c49d158e74-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-665b39d6-3e4b-4f31-ad39-81b47c6c3397 tempest-VolumesActionsTest-1681444817 None] Lock "cinder-4d558151-640e-418e-8087-04c49d158e74-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-665b39d6-3e4b-4f31-ad39-81b47c6c3397 tempest-VolumesActionsTest-1681444817 None] Acquiring lock "cinder-quobyte-4d558151-640e-418e-8087-04c49d158e74" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:12 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-665b39d6-3e4b-4f31-ad39-81b47c6c3397 tempest-VolumesActionsTest-1681444817 None] Lock "cinder-quobyte-4d558151-640e-418e-8087-04c49d158e74" acquired by "delete_volume" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9d84c236-7e34-4576-ace4-c36e4d1faee8" returned: 0 in 0.668s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.985s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-39646824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7453e31e-435a-48f0-a8e8-345c450a45f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0788f7c19c46788e78cd76ecd17584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:02:03Z,use_quota=True,user_id='b444435f111949edb1b337082027c184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Creating volume 7453e31e-435a-48f0-a8e8-345c450a45f2 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:02:12 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7453e31e-435a-48f0-a8e8-345c450a45f2 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[123abc24-0d25-418c-bbe1-c8593c1fb342]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-665b39d6-3e4b-4f31-ad39-81b47c6c3397 tempest-VolumesActionsTest-1681444817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:12 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7453e31e-435a-48f0-a8e8-345c450a45f2 1073741824 Jul 07 22:02:12 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b330cd-ea12-4364-a29b-1735d47123fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d84c236-7e34-4576-ace4-c36e4d1faee8', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83503e9-cfab-4acb-823f-7e1d70126373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:12 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Volume volume-9d84c236-7e34-4576-ace4-c36e4d1faee8 (9d84c236-7e34-4576-ace4-c36e4d1faee8): created successfully Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83503e9-cfab-4acb-823f-7e1d70126373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:12 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Flow 'volume_create_manager' (430baa2e-8290-4c70-9410-423189258035) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:02:12 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-5823742d-61e8-4a12-a7e7-67511f389cd7 tempest-VolumesTestJSON-2027793842 None] Created volume successfully. Jul 07 22:02:12 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 Jul 07 22:02:12 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:13 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-665b39d6-3e4b-4f31-ad39-81b47c6c3397 tempest-VolumesActionsTest-1681444817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74" returned: 0 in 0.786s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-665b39d6-3e4b-4f31-ad39-81b47c6c3397 tempest-VolumesActionsTest-1681444817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:13 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74 Jul 07 22:02:13 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:13 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7453e31e-435a-48f0-a8e8-345c450a45f2 1073741824" returned: 0 in 0.890s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7453e31e-435a-48f0-a8e8-345c450a45f2 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:13 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7453e31e-435a-48f0-a8e8-345c450a45f2 Jul 07 22:02:13 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Flow 'volume_create_manager' (ff8f9f4c-0727-4559-b5ba-1fb7552117e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f39c08f-1fbd-4fa3-b8b4-c2eb5fd347bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f39c08f-1fbd-4fa3-b8b4-c2eb5fd347bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1153071344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b94fc2-f3bc-40c5-bc0a-eb0648308c6c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2de8c93af00745608b325c66f2e84a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:02:13Z,use_quota=True,user_id='50e75657b0c9434983556651a2c3a81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df5c848-4c8a-4285-9b33-4ce9871c459a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df5c848-4c8a-4285-9b33-4ce9871c459a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add60d1a-d703-4ecd-b7ea-c2f2fde7da4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (add60d1a-d703-4ecd-b7ea-c2f2fde7da4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15b94fc2-f3bc-40c5-bc0a-eb0648308c6c', 'volume_name': 'volume-15b94fc2-f3bc-40c5-bc0a-eb0648308c6c', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4bb5cb-92b3-4f0e-a341-c49225a27944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4bb5cb-92b3-4f0e-a341-c49225a27944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c4d8c0-34a6-4cc3-908b-6e63b6e3bd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:13 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Volume 15b94fc2-f3bc-40c5-bc0a-eb0648308c6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15b94fc2-f3bc-40c5-bc0a-eb0648308c6c', 'volume_size': 1} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:13 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-665b39d6-3e4b-4f31-ad39-81b47c6c3397 tempest-VolumesActionsTest-1681444817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4d558151-640e-418e-8087-04c49d158e74" returned: 0 in 0.695s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-665b39d6-3e4b-4f31-ad39-81b47c6c3397 tempest-VolumesActionsTest-1681444817 None] Lock "cinder-quobyte-4d558151-640e-418e-8087-04c49d158e74" released by "delete_volume" :: held 1.536s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-665b39d6-3e4b-4f31-ad39-81b47c6c3397 tempest-VolumesActionsTest-1681444817 None] Created reservations ['71e3438c-06e5-45f7-9d27-23a23c454050', '5405a166-19be-415f-b2fd-33beeb9bd843', '79ffda51-a19a-4d87-920a-670a7acd1194', '0b1c3da0-33ae-4016-bc10-aedb596071d5'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-665b39d6-3e4b-4f31-ad39-81b47c6c3397 tempest-VolumesActionsTest-1681444817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-665b39d6-3e4b-4f31-ad39-81b47c6c3397 tempest-VolumesActionsTest-1681444817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-665b39d6-3e4b-4f31-ad39-81b47c6c3397 tempest-VolumesActionsTest-1681444817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:13 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-665b39d6-3e4b-4f31-ad39-81b47c6c3397 tempest-VolumesActionsTest-1681444817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-665b39d6-3e4b-4f31-ad39-81b47c6c3397 tempest-VolumesActionsTest-1681444817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-665b39d6-3e4b-4f31-ad39-81b47c6c3397 tempest-VolumesActionsTest-1681444817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7453e31e-435a-48f0-a8e8-345c450a45f2" returned: 0 in 0.686s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.453s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-153011373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4faa1568-b217-4f96-ba56-c0a92f4820da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6ee1d6ac5344cd80816628b6bab90c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:02:11Z,use_quota=True,user_id='0246f35133004d509343ee9e880a798d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Creating volume 4faa1568-b217-4f96-ba56-c0a92f4820da {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:13 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:02:13 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:02:13 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:13 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da 1073741824 Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff2f912-5e6b-4be8-bd46-4bf3c2eff4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7453e31e-435a-48f0-a8e8-345c450a45f2', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:13 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b90bc95-a699-4491-ae0c-972ddb61837a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:13 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Volume volume-7453e31e-435a-48f0-a8e8-345c450a45f2 (7453e31e-435a-48f0-a8e8-345c450a45f2): created successfully Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b90bc95-a699-4491-ae0c-972ddb61837a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Flow 'volume_create_manager' (cc87d9c5-042d-4c94-b80e-0c7b6f939ff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:02:13 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-b2e1bdd8-e94b-4f37-ac64-82d66d7792a3 tempest-VolumesTransfersV357Test-340832584 None] Created volume successfully. Jul 07 22:02:14 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-665b39d6-3e4b-4f31-ad39-81b47c6c3397 tempest-VolumesActionsTest-1681444817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.672s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:14 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-665b39d6-3e4b-4f31-ad39-81b47c6c3397 tempest-VolumesActionsTest-1681444817 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:02:14 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-665b39d6-3e4b-4f31-ad39-81b47c6c3397 tempest-VolumesActionsTest-1681444817 None] Deleted volume successfully. Jul 07 22:02:14 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-665b39d6-3e4b-4f31-ad39-81b47c6c3397 tempest-VolumesActionsTest-1681444817 None] Lock "cinder-4d558151-640e-418e-8087-04c49d158e74-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:14 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da 1073741824" returned: 0 in 0.848s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:14 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da Jul 07 22:02:14 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-98b0eff8-78a1-4d62-ab82-36bfa7680202 tempest-VolumesTransfersV357Test-1678212061 None] Acquiring lock "cinder-7453e31e-435a-48f0-a8e8-345c450a45f2-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-98b0eff8-78a1-4d62-ab82-36bfa7680202 tempest-VolumesTransfersV357Test-1678212061 None] Lock "cinder-7453e31e-435a-48f0-a8e8-345c450a45f2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-98b0eff8-78a1-4d62-ab82-36bfa7680202 tempest-VolumesTransfersV357Test-1678212061 None] Acquiring lock "cinder-quobyte-7453e31e-435a-48f0-a8e8-345c450a45f2" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-98b0eff8-78a1-4d62-ab82-36bfa7680202 tempest-VolumesTransfersV357Test-1678212061 None] Lock "cinder-quobyte-7453e31e-435a-48f0-a8e8-345c450a45f2" acquired by "delete_volume" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3f93d6-793f-414c-9d90-bb866d1e4302]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-98b0eff8-78a1-4d62-ab82-36bfa7680202 tempest-VolumesTransfersV357Test-1678212061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7453e31e-435a-48f0-a8e8-345c450a45f2 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:15 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7453e31e-435a-48f0-a8e8-345c450a45f2 Jul 07 22:02:15 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:15 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da" returned: 0 in 0.825s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.091s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1153071344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b94fc2-f3bc-40c5-bc0a-eb0648308c6c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2de8c93af00745608b325c66f2e84a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:02:13Z,use_quota=True,user_id='50e75657b0c9434983556651a2c3a81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Creating volume 15b94fc2-f3bc-40c5-bc0a-eb0648308c6c {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:02:15 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-15b94fc2-f3bc-40c5-bc0a-eb0648308c6c 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:15 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-15b94fc2-f3bc-40c5-bc0a-eb0648308c6c 1073741824 Jul 07 22:02:15 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025b4579-4743-48e2-9a26-cb07d5ef792b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4faa1568-b217-4f96-ba56-c0a92f4820da', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3204de8e-5c35-4495-895c-761dfdb8a400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:15 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Volume volume-4faa1568-b217-4f96-ba56-c0a92f4820da (4faa1568-b217-4f96-ba56-c0a92f4820da): created successfully Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3204de8e-5c35-4495-895c-761dfdb8a400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Flow 'volume_create_manager' (6614ec72-2500-468b-a3c0-1a4b04e33ad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:02:15 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-10891088-c533-48e9-8b73-43f965f45b5f tempest-VolumesDeleteCascade-1260294996 None] Created volume successfully. Jul 07 22:02:16 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-98b0eff8-78a1-4d62-ab82-36bfa7680202 tempest-VolumesTransfersV357Test-1678212061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7453e31e-435a-48f0-a8e8-345c450a45f2" returned: 0 in 0.851s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-98b0eff8-78a1-4d62-ab82-36bfa7680202 tempest-VolumesTransfersV357Test-1678212061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7453e31e-435a-48f0-a8e8-345c450a45f2 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:16 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7453e31e-435a-48f0-a8e8-345c450a45f2 Jul 07 22:02:16 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:16 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-15b94fc2-f3bc-40c5-bc0a-eb0648308c6c 1073741824" returned: 0 in 0.939s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-15b94fc2-f3bc-40c5-bc0a-eb0648308c6c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:16 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-15b94fc2-f3bc-40c5-bc0a-eb0648308c6c Jul 07 22:02:16 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f394f478-0dc8-4431-9f86-29dfce41d3e0 tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:16 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-98b0eff8-78a1-4d62-ab82-36bfa7680202 tempest-VolumesTransfersV357Test-1678212061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7453e31e-435a-48f0-a8e8-345c450a45f2" returned: 0 in 0.776s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-98b0eff8-78a1-4d62-ab82-36bfa7680202 tempest-VolumesTransfersV357Test-1678212061 None] Lock "cinder-quobyte-7453e31e-435a-48f0-a8e8-345c450a45f2" released by "delete_volume" :: held 1.696s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:17 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-98b0eff8-78a1-4d62-ab82-36bfa7680202 tempest-VolumesTransfersV357Test-1678212061 None] Created reservations ['fc71b34f-70ed-4bfa-ab66-dc4a3ed850fd', 'dd36bbf5-d619-4a1c-912a-f2301c565eeb', '3e685f9c-660a-4e89-9fa7-6b6b903b31ee', '757df929-e716-4a20-a4b4-56ba857dfff2'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:02:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-98b0eff8-78a1-4d62-ab82-36bfa7680202 tempest-VolumesTransfersV357Test-1678212061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-98b0eff8-78a1-4d62-ab82-36bfa7680202 tempest-VolumesTransfersV357Test-1678212061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:17 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-98b0eff8-78a1-4d62-ab82-36bfa7680202 tempest-VolumesTransfersV357Test-1678212061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:17 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-98b0eff8-78a1-4d62-ab82-36bfa7680202 tempest-VolumesTransfersV357Test-1678212061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-98b0eff8-78a1-4d62-ab82-36bfa7680202 tempest-VolumesTransfersV357Test-1678212061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-98b0eff8-78a1-4d62-ab82-36bfa7680202 tempest-VolumesTransfersV357Test-1678212061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:17 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:02:17 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:17 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-15b94fc2-f3bc-40c5-bc0a-eb0648308c6c" returned: 0 in 0.733s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:17 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:02:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f394f478-0dc8-4431-9f86-29dfce41d3e0 tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.463s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c4d8c0-34a6-4cc3-908b-6e63b6e3bd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15b94fc2-f3bc-40c5-bc0a-eb0648308c6c', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (710a7eda-ef01-4f3f-aea3-8eaee371e1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:17 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-f394f478-0dc8-4431-9f86-29dfce41d3e0 tempest-VolumesDeleteCascade-1260294996 None] Creating offline snapshot f3b09532-ca0e-44da-a9da-43df0fb9fbcf of volume 4faa1568-b217-4f96-ba56-c0a92f4820da {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:02:17 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba54ca9-158d-478a-8eb7-d088fa55413a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f394f478-0dc8-4431-9f86-29dfce41d3e0 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:17 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Volume volume-15b94fc2-f3bc-40c5-bc0a-eb0648308c6c (15b94fc2-f3bc-40c5-bc0a-eb0648308c6c): created successfully Jul 07 22:02:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (710a7eda-ef01-4f3f-aea3-8eaee371e1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Flow 'volume_create_manager' (ff8f9f4c-0727-4559-b5ba-1fb7552117e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:02:17 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-06756acf-28ea-4ce3-93f2-61beed940740 tempest-VolumesTestJSON-2027793842 None] Created volume successfully. Jul 07 22:02:17 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da Jul 07 22:02:17 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:18 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-98b0eff8-78a1-4d62-ab82-36bfa7680202 tempest-VolumesTransfersV357Test-1678212061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.906s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:18 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-98b0eff8-78a1-4d62-ab82-36bfa7680202 tempest-VolumesTransfersV357Test-1678212061 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:02:18 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-98b0eff8-78a1-4d62-ab82-36bfa7680202 tempest-VolumesTransfersV357Test-1678212061 None] Deleted volume successfully. Jul 07 22:02:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-98b0eff8-78a1-4d62-ab82-36bfa7680202 tempest-VolumesTransfersV357Test-1678212061 None] Lock "cinder-7453e31e-435a-48f0-a8e8-345c450a45f2-delete_volume" released by "delete_volume" :: held 2.857s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:18 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f394f478-0dc8-4431-9f86-29dfce41d3e0 tempest-VolumesDeleteCascade-1260294996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da" returned: 0 in 1.160s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f394f478-0dc8-4431-9f86-29dfce41d3e0 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:18 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf 1G Jul 07 22:02:18 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-47159fcf-3e6e-4fc1-9139-593a9f3ba9a2 tempest-VolumesTestJSON-2027793842 None] Acquiring lock "cinder-15b94fc2-f3bc-40c5-bc0a-eb0648308c6c-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-47159fcf-3e6e-4fc1-9139-593a9f3ba9a2 tempest-VolumesTestJSON-2027793842 None] Lock "cinder-15b94fc2-f3bc-40c5-bc0a-eb0648308c6c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-47159fcf-3e6e-4fc1-9139-593a9f3ba9a2 tempest-VolumesTestJSON-2027793842 None] Acquiring lock "cinder-quobyte-15b94fc2-f3bc-40c5-bc0a-eb0648308c6c" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-47159fcf-3e6e-4fc1-9139-593a9f3ba9a2 tempest-VolumesTestJSON-2027793842 None] Lock "cinder-quobyte-15b94fc2-f3bc-40c5-bc0a-eb0648308c6c" acquired by "delete_volume" :: waited 0.023s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:19 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc727351-2602-4e7b-8c72-2a9118d3066f]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-47159fcf-3e6e-4fc1-9139-593a9f3ba9a2 tempest-VolumesTestJSON-2027793842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-15b94fc2-f3bc-40c5-bc0a-eb0648308c6c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:19 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-15b94fc2-f3bc-40c5-bc0a-eb0648308c6c Jul 07 22:02:19 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:19 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f394f478-0dc8-4431-9f86-29dfce41d3e0 tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf 1G" returned: 0 in 1.168s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f394f478-0dc8-4431-9f86-29dfce41d3e0 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4faa1568-b217-4f96-ba56-c0a92f4820da -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:19 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4faa1568-b217-4f96-ba56-c0a92f4820da -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf Jul 07 22:02:19 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:20 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-47159fcf-3e6e-4fc1-9139-593a9f3ba9a2 tempest-VolumesTestJSON-2027793842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-15b94fc2-f3bc-40c5-bc0a-eb0648308c6c" returned: 0 in 1.129s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-47159fcf-3e6e-4fc1-9139-593a9f3ba9a2 tempest-VolumesTestJSON-2027793842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-15b94fc2-f3bc-40c5-bc0a-eb0648308c6c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:20 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-15b94fc2-f3bc-40c5-bc0a-eb0648308c6c Jul 07 22:02:20 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:20 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f394f478-0dc8-4431-9f86-29dfce41d3e0 tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4faa1568-b217-4f96-ba56-c0a92f4820da -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf" returned: 0 in 0.907s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:20 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-f394f478-0dc8-4431-9f86-29dfce41d3e0 tempest-VolumesDeleteCascade-1260294996 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf is being set with open permissions: ugo+rw Jul 07 22:02:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f394f478-0dc8-4431-9f86-29dfce41d3e0 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:20 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf Jul 07 22:02:20 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:21 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-47159fcf-3e6e-4fc1-9139-593a9f3ba9a2 tempest-VolumesTestJSON-2027793842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-15b94fc2-f3bc-40c5-bc0a-eb0648308c6c" returned: 0 in 0.862s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:21 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-47159fcf-3e6e-4fc1-9139-593a9f3ba9a2 tempest-VolumesTestJSON-2027793842 None] Lock "cinder-quobyte-15b94fc2-f3bc-40c5-bc0a-eb0648308c6c" released by "delete_volume" :: held 2.055s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:21 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-47159fcf-3e6e-4fc1-9139-593a9f3ba9a2 tempest-VolumesTestJSON-2027793842 None] Created reservations ['83ca9892-8084-4480-8b9a-bf75562096b8', '80059883-eafc-4062-9bce-ecc0374e14cc', '5279e493-38b5-4447-a2f9-ff415bb27bea', '1c805b7a-3f38-4452-9f73-03f0e765830d'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:02:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-47159fcf-3e6e-4fc1-9139-593a9f3ba9a2 tempest-VolumesTestJSON-2027793842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-47159fcf-3e6e-4fc1-9139-593a9f3ba9a2 tempest-VolumesTestJSON-2027793842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-47159fcf-3e6e-4fc1-9139-593a9f3ba9a2 tempest-VolumesTestJSON-2027793842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-47159fcf-3e6e-4fc1-9139-593a9f3ba9a2 tempest-VolumesTestJSON-2027793842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-47159fcf-3e6e-4fc1-9139-593a9f3ba9a2 tempest-VolumesTestJSON-2027793842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-47159fcf-3e6e-4fc1-9139-593a9f3ba9a2 tempest-VolumesTestJSON-2027793842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:21 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:02:21 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:21 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f394f478-0dc8-4431-9f86-29dfce41d3e0 tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf" returned: 0 in 0.880s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f394f478-0dc8-4431-9f86-29dfce41d3e0 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:21 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.info Jul 07 22:02:21 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:22 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-47159fcf-3e6e-4fc1-9139-593a9f3ba9a2 tempest-VolumesTestJSON-2027793842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.836s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:22 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-47159fcf-3e6e-4fc1-9139-593a9f3ba9a2 tempest-VolumesTestJSON-2027793842 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:02:22 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-47159fcf-3e6e-4fc1-9139-593a9f3ba9a2 tempest-VolumesTestJSON-2027793842 None] Deleted volume successfully. Jul 07 22:02:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-47159fcf-3e6e-4fc1-9139-593a9f3ba9a2 tempest-VolumesTestJSON-2027793842 None] Lock "cinder-15b94fc2-f3bc-40c5-bc0a-eb0648308c6c-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-97bce265-c40b-45f0-b838-42927ed9932b tempest-VolumesTestJSON-2027793842 None] Acquiring lock "cinder-9d84c236-7e34-4576-ace4-c36e4d1faee8-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-97bce265-c40b-45f0-b838-42927ed9932b tempest-VolumesTestJSON-2027793842 None] Lock "cinder-9d84c236-7e34-4576-ace4-c36e4d1faee8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:22 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f394f478-0dc8-4431-9f86-29dfce41d3e0 tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.info" returned: 0 in 0.913s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:22 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-f394f478-0dc8-4431-9f86-29dfce41d3e0 tempest-VolumesDeleteCascade-1260294996 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.info is being set with open permissions: ugo+rw Jul 07 22:02:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f394f478-0dc8-4431-9f86-29dfce41d3e0 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-97bce265-c40b-45f0-b838-42927ed9932b tempest-VolumesTestJSON-2027793842 None] Acquiring lock "cinder-quobyte-9d84c236-7e34-4576-ace4-c36e4d1faee8" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:22 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.info Jul 07 22:02:22 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-97bce265-c40b-45f0-b838-42927ed9932b tempest-VolumesTestJSON-2027793842 None] Lock "cinder-quobyte-9d84c236-7e34-4576-ace4-c36e4d1faee8" acquired by "delete_volume" :: waited 0.031s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:22 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[94174fbd-1bc7-4276-a9b8-9b80be6925f4]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97bce265-c40b-45f0-b838-42927ed9932b tempest-VolumesTestJSON-2027793842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9d84c236-7e34-4576-ace4-c36e4d1faee8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:22 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9d84c236-7e34-4576-ace4-c36e4d1faee8 Jul 07 22:02:22 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:23 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f394f478-0dc8-4431-9f86-29dfce41d3e0 tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.info" returned: 0 in 0.794s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f394f478-0dc8-4431-9f86-29dfce41d3e0 tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.002s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:23 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-f394f478-0dc8-4431-9f86-29dfce41d3e0 tempest-VolumesDeleteCascade-1260294996 None] Create snapshot completed successfully Jul 07 22:02:23 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97bce265-c40b-45f0-b838-42927ed9932b tempest-VolumesTestJSON-2027793842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9d84c236-7e34-4576-ace4-c36e4d1faee8" returned: 0 in 1.024s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97bce265-c40b-45f0-b838-42927ed9932b tempest-VolumesTestJSON-2027793842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9d84c236-7e34-4576-ace4-c36e4d1faee8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:23 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9d84c236-7e34-4576-ace4-c36e4d1faee8 Jul 07 22:02:23 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:24 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97bce265-c40b-45f0-b838-42927ed9932b tempest-VolumesTestJSON-2027793842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9d84c236-7e34-4576-ace4-c36e4d1faee8" returned: 0 in 0.718s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-97bce265-c40b-45f0-b838-42927ed9932b tempest-VolumesTestJSON-2027793842 None] Lock "cinder-quobyte-9d84c236-7e34-4576-ace4-c36e4d1faee8" released by "delete_volume" :: held 1.800s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:24 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-97bce265-c40b-45f0-b838-42927ed9932b tempest-VolumesTestJSON-2027793842 None] Created reservations ['26f2ccd0-47f4-48fc-904b-bf25ce0302fa', '847d721b-924d-4b38-b379-7fb02760a720', 'dc2e502a-1be5-4436-a854-a8605c178dc1', 'f1e0a54f-1b14-44c7-a633-71eb12f247b0'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:02:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-97bce265-c40b-45f0-b838-42927ed9932b tempest-VolumesTestJSON-2027793842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-97bce265-c40b-45f0-b838-42927ed9932b tempest-VolumesTestJSON-2027793842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-97bce265-c40b-45f0-b838-42927ed9932b tempest-VolumesTestJSON-2027793842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-97bce265-c40b-45f0-b838-42927ed9932b tempest-VolumesTestJSON-2027793842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-97bce265-c40b-45f0-b838-42927ed9932b tempest-VolumesTestJSON-2027793842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97bce265-c40b-45f0-b838-42927ed9932b tempest-VolumesTestJSON-2027793842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:24 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:02:24 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5b0c33cb-430a-42bb-8fc9-e4461b6a218e tempest-VolumesTestJSON-2027793842 None] Acquiring lock "cinder-5ceae82f-5a71-41d3-8977-fd82c8d9a5fd-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5b0c33cb-430a-42bb-8fc9-e4461b6a218e tempest-VolumesTestJSON-2027793842 None] Lock "cinder-5ceae82f-5a71-41d3-8977-fd82c8d9a5fd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5b0c33cb-430a-42bb-8fc9-e4461b6a218e tempest-VolumesTestJSON-2027793842 None] Acquiring lock "cinder-quobyte-5ceae82f-5a71-41d3-8977-fd82c8d9a5fd" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5b0c33cb-430a-42bb-8fc9-e4461b6a218e tempest-VolumesTestJSON-2027793842 None] Lock "cinder-quobyte-5ceae82f-5a71-41d3-8977-fd82c8d9a5fd" acquired by "delete_volume" :: waited 0.038s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[379ab327-b226-4531-bd93-b28be9aefd9e]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5b0c33cb-430a-42bb-8fc9-e4461b6a218e tempest-VolumesTestJSON-2027793842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ceae82f-5a71-41d3-8977-fd82c8d9a5fd {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Flow 'volume_create_manager' (e2b47e02-13e0-4849-9708-5aae54e8087b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ce9265-0769-420f-a76e-36cc40135ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ce9265-0769-420f-a76e-36cc40135ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2122219113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e57c09-47e2-4b8d-bfc3-9ae2e82be231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6ee1d6ac5344cd80816628b6bab90c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f3b09532-ca0e-44da-a9da-43df0fb9fbcf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:02:25Z,use_quota=True,user_id='0246f35133004d509343ee9e880a798d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a875534-2f33-4c06-a576-e8173fcc46c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a875534-2f33-4c06-a576-e8173fcc46c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cafd344d-06a5-4e56-9d74-062b7eec6680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cafd344d-06a5-4e56-9d74-062b7eec6680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '46e57c09-47e2-4b8d-bfc3-9ae2e82be231', 'volume_name': 'volume-46e57c09-47e2-4b8d-bfc3-9ae2e82be231', 'volume_size': 1, 'snapshot_id': 'f3b09532-ca0e-44da-a9da-43df0fb9fbcf'}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1e1736-3929-4657-ab08-ce9878b7eb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1e1736-3929-4657-ab08-ce9878b7eb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ad7fa8-6f82-4312-a58e-5b3a6d7a9110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:25 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Volume 46e57c09-47e2-4b8d-bfc3-9ae2e82be231: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-46e57c09-47e2-4b8d-bfc3-9ae2e82be231', 'volume_size': 1, 'snapshot_id': 'f3b09532-ca0e-44da-a9da-43df0fb9fbcf'} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "cinder-quobyte-f3b09532-ca0e-44da-a9da-43df0fb9fbcf-46e57c09-47e2-4b8d-bfc3-9ae2e82be231" by "_create_volume_from_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-quobyte-f3b09532-ca0e-44da-a9da-43df0fb9fbcf-46e57c09-47e2-4b8d-bfc3-9ae2e82be231" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Creating volume 46e57c09-47e2-4b8d-bfc3-9ae2e82be231 from snapshot f3b09532-ca0e-44da-a9da-43df0fb9fbcf {{(pid=87586) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:25 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ceae82f-5a71-41d3-8977-fd82c8d9a5fd Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:25 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "cinder-quobyte-46e57c09-47e2-4b8d-bfc3-9ae2e82be231" by "_copy_volume_from_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-quobyte-46e57c09-47e2-4b8d-bfc3-9ae2e82be231" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] snapshot: f3b09532-ca0e-44da-a9da-43df0fb9fbcf, volume: 46e57c09-47e2-4b8d-bfc3-9ae2e82be231, {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a16ec18-7257-4c71-a7bc-068c56f645cc]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:25 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf Jul 07 22:02:25 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:25 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97bce265-c40b-45f0-b838-42927ed9932b tempest-VolumesTestJSON-2027793842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.299s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-97bce265-c40b-45f0-b838-42927ed9932b tempest-VolumesTestJSON-2027793842 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:02:25 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-97bce265-c40b-45f0-b838-42927ed9932b tempest-VolumesTestJSON-2027793842 None] Deleted volume successfully. Jul 07 22:02:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-97bce265-c40b-45f0-b838-42927ed9932b tempest-VolumesTestJSON-2027793842 None] Lock "cinder-9d84c236-7e34-4576-ace4-c36e4d1faee8-delete_volume" released by "delete_volume" :: held 3.472s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:26 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:02:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Flow 'volume_create_manager' (2875e67f-b906-4edf-97a8-e95a94a9361f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:02:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8931c601-2685-4133-8aa0-c6eedbadd00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8931c601-2685-4133-8aa0-c6eedbadd00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1188545612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df433b3f-1de7-4742-96a7-f944a04e6326,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5484c142a7ba48c18a49137f5f3481c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:02:26Z,use_quota=True,user_id='0004d33fc4564941a1f544885361a846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4342b695-80dc-4abf-b579-e3c4431143d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4342b695-80dc-4abf-b579-e3c4431143d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75229e95-31c6-459a-a08b-81eb30832b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75229e95-31c6-459a-a08b-81eb30832b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df433b3f-1de7-4742-96a7-f944a04e6326', 'volume_name': 'volume-df433b3f-1de7-4742-96a7-f944a04e6326', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd44cd2b-5464-4de0-af01-ca3ec1977336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd44cd2b-5464-4de0-af01-ca3ec1977336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e8bb9a-dc4d-4467-bb37-69a261410a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:26 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Volume df433b3f-1de7-4742-96a7-f944a04e6326: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df433b3f-1de7-4742-96a7-f944a04e6326', 'volume_size': 1} Jul 07 22:02:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:26 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5b0c33cb-430a-42bb-8fc9-e4461b6a218e tempest-VolumesTestJSON-2027793842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ceae82f-5a71-41d3-8977-fd82c8d9a5fd" returned: 0 in 1.334s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5b0c33cb-430a-42bb-8fc9-e4461b6a218e tempest-VolumesTestJSON-2027793842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ceae82f-5a71-41d3-8977-fd82c8d9a5fd {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:26 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ceae82f-5a71-41d3-8977-fd82c8d9a5fd Jul 07 22:02:26 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:26 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf" returned: 0 in 1.029s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4faa1568-b217-4f96-ba56-c0a92f4820da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:02:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:02:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Creating direct copy from snapshot {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:02:26 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[22683db5-68fe-491f-9e84-4715764a0b55]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:26 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da Jul 07 22:02:26 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:27 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5b0c33cb-430a-42bb-8fc9-e4461b6a218e tempest-VolumesTestJSON-2027793842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5ceae82f-5a71-41d3-8977-fd82c8d9a5fd" returned: 0 in 0.828s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5b0c33cb-430a-42bb-8fc9-e4461b6a218e tempest-VolumesTestJSON-2027793842 None] Lock "cinder-quobyte-5ceae82f-5a71-41d3-8977-fd82c8d9a5fd" released by "delete_volume" :: held 2.226s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:27 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-5b0c33cb-430a-42bb-8fc9-e4461b6a218e tempest-VolumesTestJSON-2027793842 None] Created reservations ['39198527-84c6-4dd0-ae81-7a8994c3805c', '5e328cc8-191f-4c67-8bdf-96c5b1816549', 'fbb73e69-675a-45a6-a971-cae775ec227b', 'd54420f7-03d0-4666-9d95-5509a562ee9d'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:02:27 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da" returned: 0 in 0.894s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:27 devstack cinder-volume[87586]: DEBUG cinder.utils [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Path /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-46e57c09-47e2-4b8d-bfc3-9ae2e82be231 not found in is_blk_device check {{(pid=87586) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:02:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-46e57c09-47e2-4b8d-bfc3-9ae2e82be231 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5b0c33cb-430a-42bb-8fc9-e4461b6a218e tempest-VolumesTestJSON-2027793842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5b0c33cb-430a-42bb-8fc9-e4461b6a218e tempest-VolumesTestJSON-2027793842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:27 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5b0c33cb-430a-42bb-8fc9-e4461b6a218e tempest-VolumesTestJSON-2027793842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:27 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5b0c33cb-430a-42bb-8fc9-e4461b6a218e tempest-VolumesTestJSON-2027793842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5b0c33cb-430a-42bb-8fc9-e4461b6a218e tempest-VolumesTestJSON-2027793842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:27 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-46e57c09-47e2-4b8d-bfc3-9ae2e82be231 Jul 07 22:02:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5b0c33cb-430a-42bb-8fc9-e4461b6a218e tempest-VolumesTestJSON-2027793842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:27 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:27 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:02:27 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:28 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5b0c33cb-430a-42bb-8fc9-e4461b6a218e tempest-VolumesTestJSON-2027793842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.695s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:28 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-5b0c33cb-430a-42bb-8fc9-e4461b6a218e tempest-VolumesTestJSON-2027793842 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:02:28 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-5b0c33cb-430a-42bb-8fc9-e4461b6a218e tempest-VolumesTestJSON-2027793842 None] Deleted volume successfully. Jul 07 22:02:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5b0c33cb-430a-42bb-8fc9-e4461b6a218e tempest-VolumesTestJSON-2027793842 None] Lock "cinder-5ceae82f-5a71-41d3-8977-fd82c8d9a5fd-delete_volume" released by "delete_volume" :: held 3.268s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:33 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-46e57c09-47e2-4b8d-bfc3-9ae2e82be231" returned: 0 in 5.829s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:33 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[051a9526-3c87-4f0e-b42e-c222bd4445da]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:33 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da Jul 07 22:02:33 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:34 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da" returned: 0 in 1.253s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:34 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Image conversion details: src /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-46e57c09-47e2-4b8d-bfc3-9ae2e82be231 {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:02:34 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Converted 1024.00 MB image at 175.62 MB/s Jul 07 22:02:34 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-46e57c09-47e2-4b8d-bfc3-9ae2e82be231 is being set with open permissions: ugo+rw Jul 07 22:02:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-46e57c09-47e2-4b8d-bfc3-9ae2e82be231 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:34 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-46e57c09-47e2-4b8d-bfc3-9ae2e82be231 Jul 07 22:02:34 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:35 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-46e57c09-47e2-4b8d-bfc3-9ae2e82be231" returned: 0 in 0.828s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-quobyte-46e57c09-47e2-4b8d-bfc3-9ae2e82be231" released by "_copy_volume_from_snapshot" :: held 9.996s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-quobyte-f3b09532-ca0e-44da-a9da-43df0fb9fbcf-46e57c09-47e2-4b8d-bfc3-9ae2e82be231" released by "_create_volume_from_snapshot" :: held 10.045s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.068s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.080s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1188545612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df433b3f-1de7-4742-96a7-f944a04e6326,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5484c142a7ba48c18a49137f5f3481c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:02:26Z,use_quota=True,user_id='0004d33fc4564941a1f544885361a846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Creating volume df433b3f-1de7-4742-96a7-f944a04e6326 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:02:35 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df433b3f-1de7-4742-96a7-f944a04e6326 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:35 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df433b3f-1de7-4742-96a7-f944a04e6326 1073741824 Jul 07 22:02:35 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ad7fa8-6f82-4312-a58e-5b3a6d7a9110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46e57c09-47e2-4b8d-bfc3-9ae2e82be231', 'volume_size': 1, 'snapshot_id': 'f3b09532-ca0e-44da-a9da-43df0fb9fbcf'}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc2b54c-349a-4b79-81e7-2a3b9a65a1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:35 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Volume volume-46e57c09-47e2-4b8d-bfc3-9ae2e82be231 (46e57c09-47e2-4b8d-bfc3-9ae2e82be231): created successfully Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc2b54c-349a-4b79-81e7-2a3b9a65a1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Flow 'volume_create_manager' (e2b47e02-13e0-4849-9708-5aae54e8087b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:02:35 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ce70968b-8ece-4477-a211-be4ca2a46efd tempest-VolumesDeleteCascade-1260294996 None] Created volume successfully. Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:35 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:02:35 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-61880d79-3bbd-4a61-aa2f-8f19c724dcce tempest-BackendsCapabilitiesAdminTestsJSON-930794141 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.693115234375, 'free_capacity_gb': 1775.693115234375, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87586) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4836}} Jul 07 22:02:36 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.899s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:02:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:02:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 28 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 22:02:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 22:02:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "cinder-4faa1568-b217-4f96-ba56-c0a92f4820da-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-4faa1568-b217-4f96-ba56-c0a92f4820da-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:36 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df433b3f-1de7-4742-96a7-f944a04e6326 1073741824" returned: 0 in 1.282s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Performing cascade delete. {{(pid=87586) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 22:02:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a07fe113-0689-4565-8229-56ec1cee525a tempest-BackendsCapabilitiesAdminTestsJSON-930794141 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.693115234375, 'free_capacity_gb': 1775.693115234375, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87586) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4836}} Jul 07 22:02:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "cinder-f3b09532-ca0e-44da-a9da-43df0fb9fbcf-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-f3b09532-ca0e-44da-a9da-43df0fb9fbcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df433b3f-1de7-4742-96a7-f944a04e6326 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "cinder-quobyte-4faa1568-b217-4f96-ba56-c0a92f4820da" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-quobyte-4faa1568-b217-4f96-ba56-c0a92f4820da" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "cinder-quobyte-f3b09532-ca0e-44da-a9da-43df0fb9fbcf" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:36 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df433b3f-1de7-4742-96a7-f944a04e6326 Jul 07 22:02:36 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-quobyte-f3b09532-ca0e-44da-a9da-43df0fb9fbcf" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:36 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Deleting offline snapshot f3b09532-ca0e-44da-a9da-43df0fb9fbcf of volume 4faa1568-b217-4f96-ba56-c0a92f4820da {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:02:36 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] snapshot_file for this snap is: volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:02:36 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b8a62b-e5c6-40dd-825c-a641452b7911]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:36 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf Jul 07 22:02:36 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df433b3f-1de7-4742-96a7-f944a04e6326" returned: 0 in 0.790s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:37 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] <== create_volume: return (2170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:02:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.176s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e8bb9a-dc4d-4467-bb37-69a261410a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df433b3f-1de7-4742-96a7-f944a04e6326', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b78e02-a10a-4fdc-8a13-2b1d0dc20096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:37 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Volume volume-df433b3f-1de7-4742-96a7-f944a04e6326 (df433b3f-1de7-4742-96a7-f944a04e6326): created successfully Jul 07 22:02:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b78e02-a10a-4fdc-8a13-2b1d0dc20096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Flow 'volume_create_manager' (2875e67f-b906-4edf-97a8-e95a94a9361f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:02:37 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6bccd754-cdc6-408f-9392-db4bca9b1cb4 tempest-VolumesListTestJSON-1251758759 None] Created volume successfully. Jul 07 22:02:37 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf" returned: 0 in 1.090s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4faa1568-b217-4f96-ba56-c0a92f4820da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:02:37 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d26b9a-d9ee-4fe4-a4b4-68d10f38f308]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:38 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da Jul 07 22:02:38 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:39 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da" returned: 0 in 1.073s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:39 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf Jul 07 22:02:39 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Flow 'volume_create_manager' (a84ea68e-53a3-4282-9ae3-ab7f5d1a35b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec73839-7b08-4a5f-b89f-17d565dd2b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec73839-7b08-4a5f-b89f-17d565dd2b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1187608259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a2d5dae-ca22-4f88-9502-5101327b83fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5484c142a7ba48c18a49137f5f3481c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:02:39Z,use_quota=True,user_id='0004d33fc4564941a1f544885361a846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c7a23c-e418-47ab-9daf-3e3774ca129b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c7a23c-e418-47ab-9daf-3e3774ca129b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d3ed02-2423-411e-8e94-7f067d3165a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d3ed02-2423-411e-8e94-7f067d3165a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a2d5dae-ca22-4f88-9502-5101327b83fc', 'volume_name': 'volume-0a2d5dae-ca22-4f88-9502-5101327b83fc', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a10675-1fbb-433a-bfea-d43977593d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a10675-1fbb-433a-bfea-d43977593d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c5e421-d4a5-4e76-816f-abd1d72d59c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:39 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Volume 0a2d5dae-ca22-4f88-9502-5101327b83fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a2d5dae-ca22-4f88-9502-5101327b83fc', 'volume_size': 1} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1187608259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a2d5dae-ca22-4f88-9502-5101327b83fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5484c142a7ba48c18a49137f5f3481c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:02:39Z,use_quota=True,user_id='0004d33fc4564941a1f544885361a846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Creating volume 0a2d5dae-ca22-4f88-9502-5101327b83fc {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:02:39 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a2d5dae-ca22-4f88-9502-5101327b83fc 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:02:39 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a2d5dae-ca22-4f88-9502-5101327b83fc 1073741824 Jul 07 22:02:39 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Flow 'volume_create_manager' (eb0ad291-caa0-4fbe-8727-11c43f561135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb52e8d-bfa0-4bfb-963e-8e918adb49b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb52e8d-bfa0-4bfb-963e-8e918adb49b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1851005765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905036a9-e532-48bc-b5e7-02f6acda00f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2134704110b4381b38e4e2a19049750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:02:39Z,use_quota=True,user_id='5ad0c11f603a458cb92dd5ec16514961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6b74b7-07e9-4a6e-80c0-32ca38920d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6b74b7-07e9-4a6e-80c0-32ca38920d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4248aba3-a28d-4959-b0b4-1b7db0c4af51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4248aba3-a28d-4959-b0b4-1b7db0c4af51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '905036a9-e532-48bc-b5e7-02f6acda00f0', 'volume_name': 'volume-905036a9-e532-48bc-b5e7-02f6acda00f0', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6a16ef-1974-4e0d-b621-25163f19b079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6a16ef-1974-4e0d-b621-25163f19b079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d69bed-0793-44ac-bb2a-cffd9943bbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:39 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Volume 905036a9-e532-48bc-b5e7-02f6acda00f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-905036a9-e532-48bc-b5e7-02f6acda00f0', 'volume_size': 1} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:39 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf" returned: 0 in 0.898s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:39 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf Jul 07 22:02:39 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:40 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a2d5dae-ca22-4f88-9502-5101327b83fc 1073741824" returned: 0 in 1.044s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a2d5dae-ca22-4f88-9502-5101327b83fc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:40 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a2d5dae-ca22-4f88-9502-5101327b83fc Jul 07 22:02:40 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:40 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da.f3b09532-ca0e-44da-a9da-43df0fb9fbcf" returned: 0 in 0.726s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-quobyte-f3b09532-ca0e-44da-a9da-43df0fb9fbcf" released by "_delete_snapshot" :: held 3.936s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-quobyte-4faa1568-b217-4f96-ba56-c0a92f4820da" released by "delete_snapshot" :: held 3.966s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:40 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Created reservations ['c158425d-06b0-4e56-a2cc-7f92510a924b', 'e18765b6-5643-4412-8429-422ba3d2001a', '67cf89ec-91e9-438e-8640-094992b55e1c', 'a436946d-5043-4afb-aa4d-f829c9f5e52b'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:02:40 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Delete snapshot completed successfully. Jul 07 22:02:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-f3b09532-ca0e-44da-a9da-43df0fb9fbcf-delete_snapshot" released by "delete_snapshot" :: held 4.171s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Snapshots deleted, issuing volume delete {{(pid=87586) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 22:02:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "cinder-quobyte-4faa1568-b217-4f96-ba56-c0a92f4820da" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-quobyte-4faa1568-b217-4f96-ba56-c0a92f4820da" acquired by "delete_volume" :: waited 0.030s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:40 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6608ff65-ea3b-454c-bbbe-e0668679a406]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:41 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a2d5dae-ca22-4f88-9502-5101327b83fc" returned: 0 in 0.775s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:02:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.762s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1851005765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905036a9-e532-48bc-b5e7-02f6acda00f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2134704110b4381b38e4e2a19049750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:02:39Z,use_quota=True,user_id='5ad0c11f603a458cb92dd5ec16514961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:02:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Creating volume 905036a9-e532-48bc-b5e7-02f6acda00f0 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:02:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:41 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da Jul 07 22:02:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:02:41 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:02:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:41 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:41 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0 1073741824 Jul 07 22:02:41 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c5e421-d4a5-4e76-816f-abd1d72d59c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a2d5dae-ca22-4f88-9502-5101327b83fc', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d3a71e-5830-4665-8bb3-fa8d0699c611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:41 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Volume volume-0a2d5dae-ca22-4f88-9502-5101327b83fc (0a2d5dae-ca22-4f88-9502-5101327b83fc): created successfully Jul 07 22:02:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d3a71e-5830-4665-8bb3-fa8d0699c611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Flow 'volume_create_manager' (a84ea68e-53a3-4282-9ae3-ab7f5d1a35b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:02:41 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-672c38d1-5544-4ec3-b929-a86c94bc587e tempest-VolumesListTestJSON-1251758759 None] Created volume successfully. Jul 07 22:02:41 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da" returned: 0 in 0.815s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:41 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da Jul 07 22:02:41 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:42 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0 1073741824" returned: 0 in 1.065s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:42 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0 Jul 07 22:02:42 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:42 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4faa1568-b217-4f96-ba56-c0a92f4820da" returned: 0 in 0.835s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-quobyte-4faa1568-b217-4f96-ba56-c0a92f4820da" released by "delete_volume" :: held 1.772s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Flow 'volume_create_manager' (d1cf2b05-d158-4491-90ef-1163adf18cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0349028-a8ab-4284-b613-7f4a263f4aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0349028-a8ab-4284-b613-7f4a263f4aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1521353416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5814672-debe-4a74-af50-9980f13fc884,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5484c142a7ba48c18a49137f5f3481c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:02:43Z,use_quota=True,user_id='0004d33fc4564941a1f544885361a846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ea4581-76f1-463d-98fd-5d7e16cc9056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ea4581-76f1-463d-98fd-5d7e16cc9056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86d45cb-9d5e-4b5b-a274-4db531f7cfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86d45cb-9d5e-4b5b-a274-4db531f7cfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5814672-debe-4a74-af50-9980f13fc884', 'volume_name': 'volume-f5814672-debe-4a74-af50-9980f13fc884', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca4339e-9ff3-4556-82be-72ab4d450df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca4339e-9ff3-4556-82be-72ab4d450df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e12359-8612-4f5e-bd3b-08fa2f412334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:42 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Volume f5814672-debe-4a74-af50-9980f13fc884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5814672-debe-4a74-af50-9980f13fc884', 'volume_size': 1} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Created reservations ['8b7b9410-6b19-41a0-a66c-8b9eb03dbd64', '14030eab-91b0-4b5b-8f01-b25340a4ca54', '7025bf3b-ff35-4d51-8628-157550805cfd', 'e5747c35-f57e-42b4-bd89-bb7570e2ec80'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:42 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0" returned: 0 in 0.728s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:42 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:02:42 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.125s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1521353416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5814672-debe-4a74-af50-9980f13fc884,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5484c142a7ba48c18a49137f5f3481c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:02:43Z,use_quota=True,user_id='0004d33fc4564941a1f544885361a846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Creating volume f5814672-debe-4a74-af50-9980f13fc884 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:02:42 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f5814672-debe-4a74-af50-9980f13fc884 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:42 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f5814672-debe-4a74-af50-9980f13fc884 1073741824 Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d69bed-0793-44ac-bb2a-cffd9943bbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-905036a9-e532-48bc-b5e7-02f6acda00f0', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:42 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31bf6e5e-d83c-407c-bc2b-0e5725f70c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:43 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Volume volume-905036a9-e532-48bc-b5e7-02f6acda00f0 (905036a9-e532-48bc-b5e7-02f6acda00f0): created successfully Jul 07 22:02:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31bf6e5e-d83c-407c-bc2b-0e5725f70c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Flow 'volume_create_manager' (eb0ad291-caa0-4fbe-8727-11c43f561135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:02:43 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-7fd24bcd-3da2-4dee-834b-48ea66bfdfbc tempest-VolumesSnapshotTestJSON-1830172248 None] Created volume successfully. Jul 07 22:02:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4709f57f-0882-466a-98ac-ac4d6c04a239 tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "cinder-46e57c09-47e2-4b8d-bfc3-9ae2e82be231-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4709f57f-0882-466a-98ac-ac4d6c04a239 tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-46e57c09-47e2-4b8d-bfc3-9ae2e82be231-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4709f57f-0882-466a-98ac-ac4d6c04a239 tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "cinder-quobyte-46e57c09-47e2-4b8d-bfc3-9ae2e82be231" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4709f57f-0882-466a-98ac-ac4d6c04a239 tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-quobyte-46e57c09-47e2-4b8d-bfc3-9ae2e82be231" acquired by "delete_volume" :: waited 0.034s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0adaa350-4d33-46e4-af89-8c2732768b03 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:43 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54c177f-e19a-47df-bca3-6ab87fa29d95]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4709f57f-0882-466a-98ac-ac4d6c04a239 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-46e57c09-47e2-4b8d-bfc3-9ae2e82be231 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:43 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.068s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:43 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:02:43 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Deleted volume successfully. Jul 07 22:02:43 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=91,cinder:DELETE=9,cinder:UPDATE=112,cinder:INSERT=25 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:02:43 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-46e57c09-47e2-4b8d-bfc3-9ae2e82be231 Jul 07 22:02:43 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:44 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5f7aee6d-aa30-4283-a414-5e5a98215041 tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-4faa1568-b217-4f96-ba56-c0a92f4820da-delete_volume" released by "delete_volume" :: held 7.441s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:44 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f5814672-debe-4a74-af50-9980f13fc884 1073741824" returned: 0 in 1.474s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:44 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=82,cinder:UPDATE=114,cinder:DELETE=11,cinder:INSERT=29 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:02:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f5814672-debe-4a74-af50-9980f13fc884 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:44 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f5814672-debe-4a74-af50-9980f13fc884 Jul 07 22:02:44 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:44 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4709f57f-0882-466a-98ac-ac4d6c04a239 tempest-VolumesDeleteCascade-1260294996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-46e57c09-47e2-4b8d-bfc3-9ae2e82be231" returned: 0 in 0.873s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4709f57f-0882-466a-98ac-ac4d6c04a239 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-46e57c09-47e2-4b8d-bfc3-9ae2e82be231 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:44 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-46e57c09-47e2-4b8d-bfc3-9ae2e82be231 Jul 07 22:02:44 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:45 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f5814672-debe-4a74-af50-9980f13fc884" returned: 0 in 0.718s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] <== create_volume: return (2254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:02:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.258s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0adaa350-4d33-46e4-af89-8c2732768b03 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.353s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e12359-8612-4f5e-bd3b-08fa2f412334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5814672-debe-4a74-af50-9980f13fc884', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abcd00a6-94a5-4955-846b-e3db816c8f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-0adaa350-4d33-46e4-af89-8c2732768b03 tempest-VolumesSnapshotTestJSON-1830172248 None] Creating offline snapshot 7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01 of volume 905036a9-e532-48bc-b5e7-02f6acda00f0 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:02:45 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Volume volume-f5814672-debe-4a74-af50-9980f13fc884 (f5814672-debe-4a74-af50-9980f13fc884): created successfully Jul 07 22:02:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abcd00a6-94a5-4955-846b-e3db816c8f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Flow 'volume_create_manager' (d1cf2b05-d158-4491-90ef-1163adf18cd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:02:45 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[76622327-b29d-4f6e-a2a9-0e0cda0c6cbd]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0adaa350-4d33-46e4-af89-8c2732768b03 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:45 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-cd6ae25a-d4b0-47d3-a3a0-4c5e6e30763c tempest-VolumesListTestJSON-1251758759 None] Created volume successfully. Jul 07 22:02:45 devstack sudo[97697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0 Jul 07 22:02:45 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:45 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4709f57f-0882-466a-98ac-ac4d6c04a239 tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-46e57c09-47e2-4b8d-bfc3-9ae2e82be231" returned: 0 in 0.735s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:45 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4709f57f-0882-466a-98ac-ac4d6c04a239 tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-quobyte-46e57c09-47e2-4b8d-bfc3-9ae2e82be231" released by "delete_volume" :: held 1.687s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:45 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-4709f57f-0882-466a-98ac-ac4d6c04a239 tempest-VolumesDeleteCascade-1260294996 None] Created reservations ['681272a9-c3b5-40e4-8491-c3a1423d718e', '445898a9-a7f2-4a19-a85e-6ac9f06176b6', 'e871d02a-784f-4040-bd53-75b630546cfb', '92a2a895-6905-485c-b9b4-072e9bc2a7bf'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:02:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4709f57f-0882-466a-98ac-ac4d6c04a239 tempest-VolumesDeleteCascade-1260294996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4709f57f-0882-466a-98ac-ac4d6c04a239 tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4709f57f-0882-466a-98ac-ac4d6c04a239 tempest-VolumesDeleteCascade-1260294996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4709f57f-0882-466a-98ac-ac4d6c04a239 tempest-VolumesDeleteCascade-1260294996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4709f57f-0882-466a-98ac-ac4d6c04a239 tempest-VolumesDeleteCascade-1260294996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4709f57f-0882-466a-98ac-ac4d6c04a239 tempest-VolumesDeleteCascade-1260294996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:45 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:02:45 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:46 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0adaa350-4d33-46e4-af89-8c2732768b03 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0" returned: 0 in 0.963s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0adaa350-4d33-46e4-af89-8c2732768b03 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:46 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01 1G Jul 07 22:02:46 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:46 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4709f57f-0882-466a-98ac-ac4d6c04a239 tempest-VolumesDeleteCascade-1260294996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.001s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:46 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-4709f57f-0882-466a-98ac-ac4d6c04a239 tempest-VolumesDeleteCascade-1260294996 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:02:46 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-4709f57f-0882-466a-98ac-ac4d6c04a239 tempest-VolumesDeleteCascade-1260294996 None] Deleted volume successfully. Jul 07 22:02:46 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4709f57f-0882-466a-98ac-ac4d6c04a239 tempest-VolumesDeleteCascade-1260294996 None] Lock "cinder-46e57c09-47e2-4b8d-bfc3-9ae2e82be231-delete_volume" released by "delete_volume" :: held 2.977s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:47 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0adaa350-4d33-46e4-af89-8c2732768b03 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01 1G" returned: 0 in 1.220s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0adaa350-4d33-46e4-af89-8c2732768b03 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905036a9-e532-48bc-b5e7-02f6acda00f0 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:47 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905036a9-e532-48bc-b5e7-02f6acda00f0 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01 Jul 07 22:02:47 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:48 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0adaa350-4d33-46e4-af89-8c2732768b03 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905036a9-e532-48bc-b5e7-02f6acda00f0 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01" returned: 0 in 1.027s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:48 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-0adaa350-4d33-46e4-af89-8c2732768b03 tempest-VolumesSnapshotTestJSON-1830172248 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01 is being set with open permissions: ugo+rw Jul 07 22:02:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0adaa350-4d33-46e4-af89-8c2732768b03 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:48 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01 Jul 07 22:02:48 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:49 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0adaa350-4d33-46e4-af89-8c2732768b03 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01" returned: 0 in 0.927s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0adaa350-4d33-46e4-af89-8c2732768b03 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:49 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.info Jul 07 22:02:49 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:49 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-48caee9e-d5a7-4e3a-872a-2d17affd9fc8 tempest-VolumesListTestJSON-1251758759 None] Acquiring lock "cinder-f5814672-debe-4a74-af50-9980f13fc884-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:49 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-48caee9e-d5a7-4e3a-872a-2d17affd9fc8 tempest-VolumesListTestJSON-1251758759 None] Lock "cinder-f5814672-debe-4a74-af50-9980f13fc884-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:49 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-48caee9e-d5a7-4e3a-872a-2d17affd9fc8 tempest-VolumesListTestJSON-1251758759 None] Acquiring lock "cinder-quobyte-f5814672-debe-4a74-af50-9980f13fc884" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:49 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-48caee9e-d5a7-4e3a-872a-2d17affd9fc8 tempest-VolumesListTestJSON-1251758759 None] Lock "cinder-quobyte-f5814672-debe-4a74-af50-9980f13fc884" acquired by "delete_volume" :: waited 0.021s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:49 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4942b716-d927-47e8-9529-1e155af9931d]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-48caee9e-d5a7-4e3a-872a-2d17affd9fc8 tempest-VolumesListTestJSON-1251758759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f5814672-debe-4a74-af50-9980f13fc884 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:49 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f5814672-debe-4a74-af50-9980f13fc884 Jul 07 22:02:49 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:50 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0adaa350-4d33-46e4-af89-8c2732768b03 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.info" returned: 0 in 0.820s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:50 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-0adaa350-4d33-46e4-af89-8c2732768b03 tempest-VolumesSnapshotTestJSON-1830172248 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.info is being set with open permissions: ugo+rw Jul 07 22:02:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0adaa350-4d33-46e4-af89-8c2732768b03 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:50 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.info Jul 07 22:02:50 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:50 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-48caee9e-d5a7-4e3a-872a-2d17affd9fc8 tempest-VolumesListTestJSON-1251758759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f5814672-debe-4a74-af50-9980f13fc884" returned: 0 in 0.902s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-48caee9e-d5a7-4e3a-872a-2d17affd9fc8 tempest-VolumesListTestJSON-1251758759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f5814672-debe-4a74-af50-9980f13fc884 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:50 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f5814672-debe-4a74-af50-9980f13fc884 Jul 07 22:02:50 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:51 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0adaa350-4d33-46e4-af89-8c2732768b03 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.info" returned: 0 in 0.802s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0adaa350-4d33-46e4-af89-8c2732768b03 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.918s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:51 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-0adaa350-4d33-46e4-af89-8c2732768b03 tempest-VolumesSnapshotTestJSON-1830172248 None] Create snapshot completed successfully Jul 07 22:02:51 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-48caee9e-d5a7-4e3a-872a-2d17affd9fc8 tempest-VolumesListTestJSON-1251758759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f5814672-debe-4a74-af50-9980f13fc884" returned: 0 in 0.790s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-48caee9e-d5a7-4e3a-872a-2d17affd9fc8 tempest-VolumesListTestJSON-1251758759 None] Lock "cinder-quobyte-f5814672-debe-4a74-af50-9980f13fc884" released by "delete_volume" :: held 1.747s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:51 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-48caee9e-d5a7-4e3a-872a-2d17affd9fc8 tempest-VolumesListTestJSON-1251758759 None] Created reservations ['1218e8a2-67eb-47c3-91ca-5ed57c2e5b9e', '9da07c5f-cd67-4643-91ab-77f29d873147', 'cc0bf87c-fcb2-4498-9963-daa25fa5985c', 'a645b0c5-f0d8-40ac-b675-7f14c3f83434'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:02:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-48caee9e-d5a7-4e3a-872a-2d17affd9fc8 tempest-VolumesListTestJSON-1251758759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-48caee9e-d5a7-4e3a-872a-2d17affd9fc8 tempest-VolumesListTestJSON-1251758759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-48caee9e-d5a7-4e3a-872a-2d17affd9fc8 tempest-VolumesListTestJSON-1251758759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-48caee9e-d5a7-4e3a-872a-2d17affd9fc8 tempest-VolumesListTestJSON-1251758759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-48caee9e-d5a7-4e3a-872a-2d17affd9fc8 tempest-VolumesListTestJSON-1251758759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-48caee9e-d5a7-4e3a-872a-2d17affd9fc8 tempest-VolumesListTestJSON-1251758759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:51 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:02:51 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3bbb7b39-e79c-4e63-85f4-6fb3eecdf4f0 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3bbb7b39-e79c-4e63-85f4-6fb3eecdf4f0 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3bbb7b39-e79c-4e63-85f4-6fb3eecdf4f0 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-quobyte-905036a9-e532-48bc-b5e7-02f6acda00f0" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3bbb7b39-e79c-4e63-85f4-6fb3eecdf4f0 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-905036a9-e532-48bc-b5e7-02f6acda00f0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3bbb7b39-e79c-4e63-85f4-6fb3eecdf4f0 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-quobyte-7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3bbb7b39-e79c-4e63-85f4-6fb3eecdf4f0 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-3bbb7b39-e79c-4e63-85f4-6fb3eecdf4f0 tempest-VolumesSnapshotTestJSON-1830172248 None] Deleting offline snapshot 7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01 of volume 905036a9-e532-48bc-b5e7-02f6acda00f0 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:02:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-3bbb7b39-e79c-4e63-85f4-6fb3eecdf4f0 tempest-VolumesSnapshotTestJSON-1830172248 None] snapshot_file for this snap is: volume-905036a9-e532-48bc-b5e7-02f6acda00f0.7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:02:51 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fc6806-419e-4c1d-9121-ca110b800a69]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3bbb7b39-e79c-4e63-85f4-6fb3eecdf4f0 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:51 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01 Jul 07 22:02:51 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:52 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-48caee9e-d5a7-4e3a-872a-2d17affd9fc8 tempest-VolumesListTestJSON-1251758759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.785s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-48caee9e-d5a7-4e3a-872a-2d17affd9fc8 tempest-VolumesListTestJSON-1251758759 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:02:52 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-48caee9e-d5a7-4e3a-872a-2d17affd9fc8 tempest-VolumesListTestJSON-1251758759 None] Deleted volume successfully. Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Flow 'volume_create_manager' (0c05e79a-db9a-41f3-99f1-b258ba56dfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b3f7a9-e76f-43f9-b20d-c3b55c401389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-191ea0b8-1463-4cce-9f16-242b53cd91ee tempest-VolumesListTestJSON-1251758759 None] Acquiring lock "cinder-0a2d5dae-ca22-4f88-9502-5101327b83fc-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b3f7a9-e76f-43f9-b20d-c3b55c401389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-625042017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee19ba6-1959-49d4-afd1-d3e3b198f05b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95703a7226b74f22b56b3798d22500b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:02:52Z,use_quota=True,user_id='871568d9d51e4681b033b556671e2ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdac2d01-8132-4316-aed7-10c14d5e4bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdac2d01-8132-4316-aed7-10c14d5e4bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d497d4-223e-4c5d-877a-5f8bd86aef20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d497d4-223e-4c5d-877a-5f8bd86aef20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bee19ba6-1959-49d4-afd1-d3e3b198f05b', 'volume_name': 'volume-bee19ba6-1959-49d4-afd1-d3e3b198f05b', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7338c37-5353-43fb-aa1c-78af33da722c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7338c37-5353-43fb-aa1c-78af33da722c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7bef4af-03a0-480b-94df-40fdeffa9708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:52 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Volume bee19ba6-1959-49d4-afd1-d3e3b198f05b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bee19ba6-1959-49d4-afd1-d3e3b198f05b', 'volume_size': 1} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-625042017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee19ba6-1959-49d4-afd1-d3e3b198f05b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95703a7226b74f22b56b3798d22500b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:02:52Z,use_quota=True,user_id='871568d9d51e4681b033b556671e2ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Creating volume bee19ba6-1959-49d4-afd1-d3e3b198f05b {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:02:52 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bee19ba6-1959-49d4-afd1-d3e3b198f05b 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-48caee9e-d5a7-4e3a-872a-2d17affd9fc8 tempest-VolumesListTestJSON-1251758759 None] Lock "cinder-f5814672-debe-4a74-af50-9980f13fc884-delete_volume" released by "delete_volume" :: held 2.948s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-191ea0b8-1463-4cce-9f16-242b53cd91ee tempest-VolumesListTestJSON-1251758759 None] Lock "cinder-0a2d5dae-ca22-4f88-9502-5101327b83fc-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:52 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bee19ba6-1959-49d4-afd1-d3e3b198f05b 1073741824 Jul 07 22:02:52 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-191ea0b8-1463-4cce-9f16-242b53cd91ee tempest-VolumesListTestJSON-1251758759 None] Acquiring lock "cinder-quobyte-0a2d5dae-ca22-4f88-9502-5101327b83fc" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-191ea0b8-1463-4cce-9f16-242b53cd91ee tempest-VolumesListTestJSON-1251758759 None] Lock "cinder-quobyte-0a2d5dae-ca22-4f88-9502-5101327b83fc" acquired by "delete_volume" :: waited 0.021s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b82c53-4bab-4186-98c3-a6d1c94be68a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-191ea0b8-1463-4cce-9f16-242b53cd91ee tempest-VolumesListTestJSON-1251758759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a2d5dae-ca22-4f88-9502-5101327b83fc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:52 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a2d5dae-ca22-4f88-9502-5101327b83fc Jul 07 22:02:52 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:52 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3bbb7b39-e79c-4e63-85f4-6fb3eecdf4f0 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01" returned: 0 in 0.998s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-3bbb7b39-e79c-4e63-85f4-6fb3eecdf4f0 tempest-VolumesSnapshotTestJSON-1830172248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-905036a9-e532-48bc-b5e7-02f6acda00f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[74389e9f-98ec-4b90-a18a-8727ad171ceb]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3bbb7b39-e79c-4e63-85f4-6fb3eecdf4f0 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:52 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0 Jul 07 22:02:52 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:53 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bee19ba6-1959-49d4-afd1-d3e3b198f05b 1073741824" returned: 0 in 0.928s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:53 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-191ea0b8-1463-4cce-9f16-242b53cd91ee tempest-VolumesListTestJSON-1251758759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a2d5dae-ca22-4f88-9502-5101327b83fc" returned: 0 in 0.821s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-191ea0b8-1463-4cce-9f16-242b53cd91ee tempest-VolumesListTestJSON-1251758759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a2d5dae-ca22-4f88-9502-5101327b83fc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:53 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a2d5dae-ca22-4f88-9502-5101327b83fc Jul 07 22:02:53 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bee19ba6-1959-49d4-afd1-d3e3b198f05b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:53 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bee19ba6-1959-49d4-afd1-d3e3b198f05b Jul 07 22:02:53 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:53 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3bbb7b39-e79c-4e63-85f4-6fb3eecdf4f0 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0" returned: 0 in 0.885s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3bbb7b39-e79c-4e63-85f4-6fb3eecdf4f0 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:53 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01 Jul 07 22:02:53 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:54 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-191ea0b8-1463-4cce-9f16-242b53cd91ee tempest-VolumesListTestJSON-1251758759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a2d5dae-ca22-4f88-9502-5101327b83fc" returned: 0 in 0.739s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-191ea0b8-1463-4cce-9f16-242b53cd91ee tempest-VolumesListTestJSON-1251758759 None] Lock "cinder-quobyte-0a2d5dae-ca22-4f88-9502-5101327b83fc" released by "delete_volume" :: held 1.611s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-191ea0b8-1463-4cce-9f16-242b53cd91ee tempest-VolumesListTestJSON-1251758759 None] Created reservations ['ab7e1238-14ce-4668-b565-ccdf80dd8cda', '086d3617-de4f-479a-bfca-81e7dd7762e3', '7418003e-ecd5-4f0b-b985-0c58a848cd68', '5b53bfd0-652f-4ef2-b584-3f829ab4c0f2'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:02:54 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bee19ba6-1959-49d4-afd1-d3e3b198f05b" returned: 0 in 0.800s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7bef4af-03a0-480b-94df-40fdeffa9708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bee19ba6-1959-49d4-afd1-d3e3b198f05b', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3b90b0-be07-4afe-9911-589ef729b53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:54 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Volume volume-bee19ba6-1959-49d4-afd1-d3e3b198f05b (bee19ba6-1959-49d4-afd1-d3e3b198f05b): created successfully Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3b90b0-be07-4afe-9911-589ef729b53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Flow 'volume_create_manager' (0c05e79a-db9a-41f3-99f1-b258ba56dfac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:02:54 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d0492d88-9bbf-4a2a-b967-79912bba60e9 tempest-VolumesTransfersTest-621767243 None] Created volume successfully. Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-191ea0b8-1463-4cce-9f16-242b53cd91ee tempest-VolumesListTestJSON-1251758759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-191ea0b8-1463-4cce-9f16-242b53cd91ee tempest-VolumesListTestJSON-1251758759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-191ea0b8-1463-4cce-9f16-242b53cd91ee tempest-VolumesListTestJSON-1251758759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-191ea0b8-1463-4cce-9f16-242b53cd91ee tempest-VolumesListTestJSON-1251758759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-191ea0b8-1463-4cce-9f16-242b53cd91ee tempest-VolumesListTestJSON-1251758759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-191ea0b8-1463-4cce-9f16-242b53cd91ee tempest-VolumesListTestJSON-1251758759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:54 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:02:54 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:54 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3bbb7b39-e79c-4e63-85f4-6fb3eecdf4f0 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01" returned: 0 in 0.856s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3bbb7b39-e79c-4e63-85f4-6fb3eecdf4f0 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:54 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01 Jul 07 22:02:54 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-eb7d426e-49e4-48f4-ab62-c5908e00b322 tempest-VolumesListTestJSON-1251758759 None] Acquiring lock "cinder-df433b3f-1de7-4742-96a7-f944a04e6326-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-eb7d426e-49e4-48f4-ab62-c5908e00b322 tempest-VolumesListTestJSON-1251758759 None] Lock "cinder-df433b3f-1de7-4742-96a7-f944a04e6326-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-eb7d426e-49e4-48f4-ab62-c5908e00b322 tempest-VolumesListTestJSON-1251758759 None] Acquiring lock "cinder-quobyte-df433b3f-1de7-4742-96a7-f944a04e6326" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-eb7d426e-49e4-48f4-ab62-c5908e00b322 tempest-VolumesListTestJSON-1251758759 None] Lock "cinder-quobyte-df433b3f-1de7-4742-96a7-f944a04e6326" acquired by "delete_volume" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[062d5b75-5e2c-4664-ac74-8d028edfd402]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb7d426e-49e4-48f4-ab62-c5908e00b322 tempest-VolumesListTestJSON-1251758759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df433b3f-1de7-4742-96a7-f944a04e6326 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:55 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df433b3f-1de7-4742-96a7-f944a04e6326 Jul 07 22:02:55 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:55 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-191ea0b8-1463-4cce-9f16-242b53cd91ee tempest-VolumesListTestJSON-1251758759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.695s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:55 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-191ea0b8-1463-4cce-9f16-242b53cd91ee tempest-VolumesListTestJSON-1251758759 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:02:55 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-191ea0b8-1463-4cce-9f16-242b53cd91ee tempest-VolumesListTestJSON-1251758759 None] Deleted volume successfully. Jul 07 22:02:55 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-191ea0b8-1463-4cce-9f16-242b53cd91ee tempest-VolumesListTestJSON-1251758759 None] Lock "cinder-0a2d5dae-ca22-4f88-9502-5101327b83fc-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:55 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3bbb7b39-e79c-4e63-85f4-6fb3eecdf4f0 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0.7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01" returned: 0 in 0.694s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:55 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3bbb7b39-e79c-4e63-85f4-6fb3eecdf4f0 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01" released by "_delete_snapshot" :: held 3.556s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:55 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3bbb7b39-e79c-4e63-85f4-6fb3eecdf4f0 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-905036a9-e532-48bc-b5e7-02f6acda00f0" released by "delete_snapshot" :: held 3.579s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:55 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-3bbb7b39-e79c-4e63-85f4-6fb3eecdf4f0 tempest-VolumesSnapshotTestJSON-1830172248 None] Created reservations ['14323fce-e4f0-4327-ac9f-f694ebb460d3', '14adaf0c-0d51-45db-981c-63c14207810c', '3f0a5a3d-e22f-49a5-a91b-f8331a9ea44c', '24570f26-0677-4604-85fb-a056b986b5d1'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:02:55 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-3bbb7b39-e79c-4e63-85f4-6fb3eecdf4f0 tempest-VolumesSnapshotTestJSON-1830172248 None] Delete snapshot completed successfully. Jul 07 22:02:55 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3bbb7b39-e79c-4e63-85f4-6fb3eecdf4f0 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-7d44df6a-2ee6-4d5e-8cef-f2f5f2aafa01-delete_snapshot" released by "delete_snapshot" :: held 3.759s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:55 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb7d426e-49e4-48f4-ab62-c5908e00b322 tempest-VolumesListTestJSON-1251758759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df433b3f-1de7-4742-96a7-f944a04e6326" returned: 0 in 0.835s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb7d426e-49e4-48f4-ab62-c5908e00b322 tempest-VolumesListTestJSON-1251758759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df433b3f-1de7-4742-96a7-f944a04e6326 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:55 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df433b3f-1de7-4742-96a7-f944a04e6326 Jul 07 22:02:55 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:56 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-1847938b-77ad-41c8-a18a-a81ba1ba0d28 tempest-VolumesTransfersTest-1899380078 None] Transfer volume completed successfully. Jul 07 22:02:56 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb7d426e-49e4-48f4-ab62-c5908e00b322 tempest-VolumesListTestJSON-1251758759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df433b3f-1de7-4742-96a7-f944a04e6326" returned: 0 in 0.718s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-eb7d426e-49e4-48f4-ab62-c5908e00b322 tempest-VolumesListTestJSON-1251758759 None] Lock "cinder-quobyte-df433b3f-1de7-4742-96a7-f944a04e6326" released by "delete_volume" :: held 1.609s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:56 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-eb7d426e-49e4-48f4-ab62-c5908e00b322 tempest-VolumesListTestJSON-1251758759 None] Created reservations ['0fd13c9b-bfc7-4df3-82ae-c73a3beca114', 'dfc22b1b-8e49-4abf-bf03-7e6325a3b65a', '8cb60f01-8745-4c4d-b7ed-7eaff5a7dc97', '73c9c990-1f41-4305-a61a-d5cee2fb3607'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:02:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-eb7d426e-49e4-48f4-ab62-c5908e00b322 tempest-VolumesListTestJSON-1251758759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-eb7d426e-49e4-48f4-ab62-c5908e00b322 tempest-VolumesListTestJSON-1251758759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-eb7d426e-49e4-48f4-ab62-c5908e00b322 tempest-VolumesListTestJSON-1251758759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-eb7d426e-49e4-48f4-ab62-c5908e00b322 tempest-VolumesListTestJSON-1251758759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-eb7d426e-49e4-48f4-ab62-c5908e00b322 tempest-VolumesListTestJSON-1251758759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb7d426e-49e4-48f4-ab62-c5908e00b322 tempest-VolumesListTestJSON-1251758759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:56 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:02:56 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Flow 'volume_create_manager' (6b2416ba-c1ca-4f63-a0de-658fe0399373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08c1c9b-eff4-434d-8b83-89e3242cdf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08c1c9b-eff4-434d-8b83-89e3242cdf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1732269964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2134704110b4381b38e4e2a19049750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:02:57Z,use_quota=True,user_id='5ad0c11f603a458cb92dd5ec16514961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4207c4-8528-4af1-9e3c-5d9b5602ba57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4207c4-8528-4af1-9e3c-5d9b5602ba57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52266f39-5b40-410a-bc6e-02c08329114e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52266f39-5b40-410a-bc6e-02c08329114e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8', 'volume_name': 'volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363219e1-5004-491c-956f-6d2b682ddc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363219e1-5004-491c-956f-6d2b682ddc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c79d6842-cdb4-4215-9ff9-c219121276c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:57 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Volume afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8', 'volume_size': 1} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1732269964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2134704110b4381b38e4e2a19049750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:02:57Z,use_quota=True,user_id='5ad0c11f603a458cb92dd5ec16514961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Creating volume afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:02:57 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:57 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 1073741824 Jul 07 22:02:57 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:57 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb7d426e-49e4-48f4-ab62-c5908e00b322 tempest-VolumesListTestJSON-1251758759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.773s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-eb7d426e-49e4-48f4-ab62-c5908e00b322 tempest-VolumesListTestJSON-1251758759 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:02:57 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-eb7d426e-49e4-48f4-ab62-c5908e00b322 tempest-VolumesListTestJSON-1251758759 None] Deleted volume successfully. Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-eb7d426e-49e4-48f4-ab62-c5908e00b322 tempest-VolumesListTestJSON-1251758759 None] Lock "cinder-df433b3f-1de7-4742-96a7-f944a04e6326-delete_volume" released by "delete_volume" :: held 2.628s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f80c7d5f-ea4e-4e36-86f1-47d5a1636b6a tempest-VolumesTransfersTest-1168805304 None] Acquiring lock "cinder-bee19ba6-1959-49d4-afd1-d3e3b198f05b-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f80c7d5f-ea4e-4e36-86f1-47d5a1636b6a tempest-VolumesTransfersTest-1168805304 None] Lock "cinder-bee19ba6-1959-49d4-afd1-d3e3b198f05b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f80c7d5f-ea4e-4e36-86f1-47d5a1636b6a tempest-VolumesTransfersTest-1168805304 None] Acquiring lock "cinder-quobyte-bee19ba6-1959-49d4-afd1-d3e3b198f05b" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f80c7d5f-ea4e-4e36-86f1-47d5a1636b6a tempest-VolumesTransfersTest-1168805304 None] Lock "cinder-quobyte-bee19ba6-1959-49d4-afd1-d3e3b198f05b" acquired by "delete_volume" :: waited 0.021s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f077dc95-12a6-40f9-b444-7aad855c5d04]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:02:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f80c7d5f-ea4e-4e36-86f1-47d5a1636b6a tempest-VolumesTransfersTest-1168805304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bee19ba6-1959-49d4-afd1-d3e3b198f05b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:57 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bee19ba6-1959-49d4-afd1-d3e3b198f05b Jul 07 22:02:57 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:58 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 1073741824" returned: 0 in 1.156s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:58 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 Jul 07 22:02:58 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:58 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f80c7d5f-ea4e-4e36-86f1-47d5a1636b6a tempest-VolumesTransfersTest-1168805304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bee19ba6-1959-49d4-afd1-d3e3b198f05b" returned: 0 in 0.952s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f80c7d5f-ea4e-4e36-86f1-47d5a1636b6a tempest-VolumesTransfersTest-1168805304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bee19ba6-1959-49d4-afd1-d3e3b198f05b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:58 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bee19ba6-1959-49d4-afd1-d3e3b198f05b Jul 07 22:02:58 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:02:59 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8" returned: 0 in 0.929s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] <== create_volume: return (2144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:02:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.148s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c79d6842-cdb4-4215-9ff9-c219121276c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ff9644-eccb-43f5-9db1-80ee4df1ac16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:02:59 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Volume volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 (afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8): created successfully Jul 07 22:02:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ff9644-eccb-43f5-9db1-80ee4df1ac16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:02:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Flow 'volume_create_manager' (6b2416ba-c1ca-4f63-a0de-658fe0399373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:02:59 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-3a0e7fbf-b21c-4f65-8812-eaf707912718 tempest-VolumesSnapshotTestJSON-1830172248 None] Created volume successfully. Jul 07 22:02:59 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Jul 07 22:02:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f80c7d5f-ea4e-4e36-86f1-47d5a1636b6a tempest-VolumesTransfersTest-1168805304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bee19ba6-1959-49d4-afd1-d3e3b198f05b" returned: 0 in 0.759s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:02:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f80c7d5f-ea4e-4e36-86f1-47d5a1636b6a tempest-VolumesTransfersTest-1168805304 None] Lock "cinder-quobyte-bee19ba6-1959-49d4-afd1-d3e3b198f05b" released by "delete_volume" :: held 1.765s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:02:59 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-f80c7d5f-ea4e-4e36-86f1-47d5a1636b6a tempest-VolumesTransfersTest-1168805304 None] Created reservations ['dbb28642-c733-43bb-87a1-180d3b4a7922', '6cba6aef-d456-4571-9be0-0252dd6f412d', 'cf45dd76-f692-4c42-9e85-9ffc21f6c008', '6246eb68-7b5a-4da6-abaf-c30046ed9963'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:02:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f80c7d5f-ea4e-4e36-86f1-47d5a1636b6a tempest-VolumesTransfersTest-1168805304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:02:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f80c7d5f-ea4e-4e36-86f1-47d5a1636b6a tempest-VolumesTransfersTest-1168805304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:02:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f80c7d5f-ea4e-4e36-86f1-47d5a1636b6a tempest-VolumesTransfersTest-1168805304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:02:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f80c7d5f-ea4e-4e36-86f1-47d5a1636b6a tempest-VolumesTransfersTest-1168805304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:02:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f80c7d5f-ea4e-4e36-86f1-47d5a1636b6a tempest-VolumesTransfersTest-1168805304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:02:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f80c7d5f-ea4e-4e36-86f1-47d5a1636b6a tempest-VolumesTransfersTest-1168805304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:02:59 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:02:59 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aee280eb-43f6-408a-99b3-679d83861bd9 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aee280eb-43f6-408a-99b3-679d83861bd9 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-aee280eb-43f6-408a-99b3-679d83861bd9 tempest-VolumesSnapshotTestJSON-1830172248 None] Creating offline snapshot 6eca9646-32e8-4567-a030-957497dbc88d of volume afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:03:00 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c8c380-8b7d-4bf9-a280-da3c0a642dde]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:03:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aee280eb-43f6-408a-99b3-679d83861bd9 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:00 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f80c7d5f-ea4e-4e36-86f1-47d5a1636b6a tempest-VolumesTransfersTest-1168805304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.882s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:00 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-f80c7d5f-ea4e-4e36-86f1-47d5a1636b6a tempest-VolumesTransfersTest-1168805304 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:03:00 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-f80c7d5f-ea4e-4e36-86f1-47d5a1636b6a tempest-VolumesTransfersTest-1168805304 None] Deleted volume successfully. Jul 07 22:03:00 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 Jul 07 22:03:00 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:00 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f80c7d5f-ea4e-4e36-86f1-47d5a1636b6a tempest-VolumesTransfersTest-1168805304 None] Lock "cinder-bee19ba6-1959-49d4-afd1-d3e3b198f05b-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:00 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:03:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Flow 'volume_create_manager' (3e21bcc9-3332-4099-bc34-136bef367e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:03:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9bd342a-3556-43aa-b615-a61d1a0e2f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9bd342a-3556-43aa-b615-a61d1a0e2f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2141034075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141af14b-79e6-41c8-bdf7-e671924dba02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95703a7226b74f22b56b3798d22500b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:03:01Z,use_quota=True,user_id='871568d9d51e4681b033b556671e2ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d0deae-21ac-4ee0-98bb-6aa1d58f49b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d0deae-21ac-4ee0-98bb-6aa1d58f49b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a6fcc49-bbb1-4d50-b2ca-fe36302837cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a6fcc49-bbb1-4d50-b2ca-fe36302837cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '141af14b-79e6-41c8-bdf7-e671924dba02', 'volume_name': 'volume-141af14b-79e6-41c8-bdf7-e671924dba02', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21902137-843c-4f48-ab90-21d543ee5a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21902137-843c-4f48-ab90-21d543ee5a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fada55-efd4-4b9c-b30f-8f765ecd50d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:00 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Volume 141af14b-79e6-41c8-bdf7-e671924dba02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-141af14b-79e6-41c8-bdf7-e671924dba02', 'volume_size': 1} Jul 07 22:03:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:01 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aee280eb-43f6-408a-99b3-679d83861bd9 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8" returned: 0 in 0.883s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aee280eb-43f6-408a-99b3-679d83861bd9 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:01 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d 1G Jul 07 22:03:01 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:01 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:03:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Flow 'volume_create_manager' (f589fbde-4e93-4e64-8f80-327c0db68da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:03:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a7d1d6-67cf-4419-ba02-4e1b1a808213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a7d1d6-67cf-4419-ba02-4e1b1a808213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1343135295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d7450e-a12b-4a50-9557-ef666230be48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc419e23fdfe4ff7abc367285d26eb72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:03:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:03:02Z,use_quota=True,user_id='56d1a554094849868951e6d2067cf59d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0dde5c-bad6-4857-8dcd-85d2e7eb216f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0dde5c-bad6-4857-8dcd-85d2e7eb216f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74fc9039-39b0-4151-b7f3-6bb7670f93e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74fc9039-39b0-4151-b7f3-6bb7670f93e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d7450e-a12b-4a50-9557-ef666230be48', 'volume_name': 'volume-e9d7450e-a12b-4a50-9557-ef666230be48', 'volume_size': 2}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (951f05ff-6a1b-4ff1-ba4c-9d9ec8bcd08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (951f05ff-6a1b-4ff1-ba4c-9d9ec8bcd08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e3b4b14-c222-47d0-bd34-5717e5e81097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:01 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Volume e9d7450e-a12b-4a50-9557-ef666230be48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d7450e-a12b-4a50-9557-ef666230be48', 'volume_size': 2} Jul 07 22:03:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:02 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aee280eb-43f6-408a-99b3-679d83861bd9 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d 1G" returned: 0 in 0.900s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aee280eb-43f6-408a-99b3-679d83861bd9 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:02 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d Jul 07 22:03:02 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:03 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aee280eb-43f6-408a-99b3-679d83861bd9 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d" returned: 0 in 0.745s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:03 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-aee280eb-43f6-408a-99b3-679d83861bd9 tempest-VolumesSnapshotTestJSON-1830172248 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d is being set with open permissions: ugo+rw Jul 07 22:03:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aee280eb-43f6-408a-99b3-679d83861bd9 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:03 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d Jul 07 22:03:03 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:03 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aee280eb-43f6-408a-99b3-679d83861bd9 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d" returned: 0 in 0.626s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aee280eb-43f6-408a-99b3-679d83861bd9 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:03 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.info Jul 07 22:03:03 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:04 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aee280eb-43f6-408a-99b3-679d83861bd9 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.info" returned: 0 in 0.635s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:04 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-aee280eb-43f6-408a-99b3-679d83861bd9 tempest-VolumesSnapshotTestJSON-1830172248 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.info is being set with open permissions: ugo+rw Jul 07 22:03:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aee280eb-43f6-408a-99b3-679d83861bd9 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:04 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.info Jul 07 22:03:04 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:05 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aee280eb-43f6-408a-99b3-679d83861bd9 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.info" returned: 0 in 0.662s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aee280eb-43f6-408a-99b3-679d83861bd9 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.582s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.168s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:05 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2141034075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141af14b-79e6-41c8-bdf7-e671924dba02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95703a7226b74f22b56b3798d22500b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:03:01Z,use_quota=True,user_id='871568d9d51e4681b033b556671e2ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:03:05 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Creating volume 141af14b-79e6-41c8-bdf7-e671924dba02 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:03:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:05 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:03:05 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:03:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:05 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:03:05 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:03:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-141af14b-79e6-41c8-bdf7-e671924dba02 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:05 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-141af14b-79e6-41c8-bdf7-e671924dba02 1073741824 Jul 07 22:03:05 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:05 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-aee280eb-43f6-408a-99b3-679d83861bd9 tempest-VolumesSnapshotTestJSON-1830172248 None] Create snapshot completed successfully Jul 07 22:03:06 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-141af14b-79e6-41c8-bdf7-e671924dba02 1073741824" returned: 0 in 1.008s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-141af14b-79e6-41c8-bdf7-e671924dba02 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:06 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-141af14b-79e6-41c8-bdf7-e671924dba02 Jul 07 22:03:06 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Flow 'volume_create_manager' (ba1473e2-2f3f-4736-8b7e-23ecd9377670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e33b092e-5397-4e69-b97c-5ffd294195d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e33b092e-5397-4e69-b97c-5ffd294195d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-129472941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2134704110b4381b38e4e2a19049750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:03:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=6eca9646-32e8-4567-a030-957497dbc88d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:03:06Z,use_quota=True,user_id='5ad0c11f603a458cb92dd5ec16514961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (305184ad-e10d-48eb-97cd-de2167d7b784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (305184ad-e10d-48eb-97cd-de2167d7b784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9bc407b-30e9-4c2c-97b9-af8854f8cca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9bc407b-30e9-4c2c-97b9-af8854f8cca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8', 'volume_name': 'volume-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8', 'volume_size': 2, 'snapshot_id': '6eca9646-32e8-4567-a030-957497dbc88d'}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ed39eb-ec05-4ffd-9f6d-a0299c1b31d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ed39eb-ec05-4ffd-9f6d-a0299c1b31d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d407037f-6477-4379-a52a-f0583c6b3fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:06 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Volume 78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8', 'volume_size': 2, 'snapshot_id': '6eca9646-32e8-4567-a030-957497dbc88d'} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:06 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-141af14b-79e6-41c8-bdf7-e671924dba02" returned: 0 in 0.799s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.169s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1343135295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d7450e-a12b-4a50-9557-ef666230be48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc419e23fdfe4ff7abc367285d26eb72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:03:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:03:02Z,use_quota=True,user_id='56d1a554094849868951e6d2067cf59d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Creating volume e9d7450e-a12b-4a50-9557-ef666230be48 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:03:06 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48 2147483648 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fada55-efd4-4b9c-b30f-8f765ecd50d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-141af14b-79e6-41c8-bdf7-e671924dba02', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d567cf9a-bf36-4f85-ba98-42b3cf6b3775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:06 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48 2147483648 Jul 07 22:03:06 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:06 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Volume volume-141af14b-79e6-41c8-bdf7-e671924dba02 (141af14b-79e6-41c8-bdf7-e671924dba02): created successfully Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d567cf9a-bf36-4f85-ba98-42b3cf6b3775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Flow 'volume_create_manager' (3e21bcc9-3332-4099-bc34-136bef367e20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:03:07 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6e87e1e7-161d-4885-a779-2542596b0c62 tempest-VolumesTransfersTest-621767243 None] Created volume successfully. Jul 07 22:03:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-bfa32a67-5b0f-4272-b818-468b457332f7 tempest-VolumesTransfersTest-1168805304 None] Acquiring lock "cinder-141af14b-79e6-41c8-bdf7-e671924dba02-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-bfa32a67-5b0f-4272-b818-468b457332f7 tempest-VolumesTransfersTest-1168805304 None] Lock "cinder-141af14b-79e6-41c8-bdf7-e671924dba02-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-bfa32a67-5b0f-4272-b818-468b457332f7 tempest-VolumesTransfersTest-1168805304 None] Acquiring lock "cinder-quobyte-141af14b-79e6-41c8-bdf7-e671924dba02" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-bfa32a67-5b0f-4272-b818-468b457332f7 tempest-VolumesTransfersTest-1168805304 None] Lock "cinder-quobyte-141af14b-79e6-41c8-bdf7-e671924dba02" acquired by "delete_volume" :: waited 0.029s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:07 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a4461a-3e5d-49d9-a8a9-a1cbf54461f2]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:03:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bfa32a67-5b0f-4272-b818-468b457332f7 tempest-VolumesTransfersTest-1168805304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-141af14b-79e6-41c8-bdf7-e671924dba02 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:07 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-141af14b-79e6-41c8-bdf7-e671924dba02 Jul 07 22:03:07 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:08 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48 2147483648" returned: 0 in 1.343s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:08 devstack sudo[97855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48 Jul 07 22:03:08 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:08 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bfa32a67-5b0f-4272-b818-468b457332f7 tempest-VolumesTransfersTest-1168805304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-141af14b-79e6-41c8-bdf7-e671924dba02" returned: 0 in 0.869s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bfa32a67-5b0f-4272-b818-468b457332f7 tempest-VolumesTransfersTest-1168805304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-141af14b-79e6-41c8-bdf7-e671924dba02 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:08 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-141af14b-79e6-41c8-bdf7-e671924dba02 Jul 07 22:03:08 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:09 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48" returned: 0 in 0.758s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] <== create_volume: return (2162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.167s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.427s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-quobyte-6eca9646-32e8-4567-a030-957497dbc88d-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8" by "_create_volume_from_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e3b4b14-c222-47d0-bd34-5717e5e81097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d7450e-a12b-4a50-9557-ef666230be48', 'volume_size': 2}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c378cdd-facd-4324-a9de-cdc6e63d7e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-6eca9646-32e8-4567-a030-957497dbc88d-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Creating volume 78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8 from snapshot 6eca9646-32e8-4567-a030-957497dbc88d {{(pid=87586) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-quobyte-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8" by "_copy_volume_from_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:09 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Volume volume-e9d7450e-a12b-4a50-9557-ef666230be48 (e9d7450e-a12b-4a50-9557-ef666230be48): created successfully Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c378cdd-facd-4324-a9de-cdc6e63d7e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Flow 'volume_create_manager' (f589fbde-4e93-4e64-8f80-327c0db68da6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] snapshot: 6eca9646-32e8-4567-a030-957497dbc88d, volume: 78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8, {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:03:09 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-dc9eeac9-5b6c-4628-a3ff-86f726dd3b61 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Created volume successfully. Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[509592fb-289f-4a42-a24a-754684b76435]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:09 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bfa32a67-5b0f-4272-b818-468b457332f7 tempest-VolumesTransfersTest-1168805304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-141af14b-79e6-41c8-bdf7-e671924dba02" returned: 0 in 0.666s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:09 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d Jul 07 22:03:09 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-bfa32a67-5b0f-4272-b818-468b457332f7 tempest-VolumesTransfersTest-1168805304 None] Lock "cinder-quobyte-141af14b-79e6-41c8-bdf7-e671924dba02" released by "delete_volume" :: held 1.593s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-bfa32a67-5b0f-4272-b818-468b457332f7 tempest-VolumesTransfersTest-1168805304 None] Created reservations ['1c4b1281-0db6-46df-a4a5-a3c0248438eb', '3294b67f-87f5-41ae-8cf0-15786b7401ac', 'b5df0c54-e410-41b4-83b7-b9d33704ad69', 'dede947b-426e-4ab5-ae5f-c1c3c0c67527'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bfa32a67-5b0f-4272-b818-468b457332f7 tempest-VolumesTransfersTest-1168805304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bfa32a67-5b0f-4272-b818-468b457332f7 tempest-VolumesTransfersTest-1168805304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-bfa32a67-5b0f-4272-b818-468b457332f7 tempest-VolumesTransfersTest-1168805304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-bfa32a67-5b0f-4272-b818-468b457332f7 tempest-VolumesTransfersTest-1168805304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bfa32a67-5b0f-4272-b818-468b457332f7 tempest-VolumesTransfersTest-1168805304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bfa32a67-5b0f-4272-b818-468b457332f7 tempest-VolumesTransfersTest-1168805304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:09 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:03:09 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:10 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d" returned: 0 in 0.896s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:03:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:03:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Creating direct copy from snapshot {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:03:10 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43194bc-ed4e-4443-85b2-1e8ca215c439]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:03:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:10 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 Jul 07 22:03:10 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:10 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bfa32a67-5b0f-4272-b818-468b457332f7 tempest-VolumesTransfersTest-1168805304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.907s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:10 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-bfa32a67-5b0f-4272-b818-468b457332f7 tempest-VolumesTransfersTest-1168805304 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:03:10 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-bfa32a67-5b0f-4272-b818-468b457332f7 tempest-VolumesTransfersTest-1168805304 None] Deleted volume successfully. Jul 07 22:03:10 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-bfa32a67-5b0f-4272-b818-468b457332f7 tempest-VolumesTransfersTest-1168805304 None] Lock "cinder-141af14b-79e6-41c8-bdf7-e671924dba02-delete_volume" released by "delete_volume" :: held 2.775s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d7ffb0ed-ff6f-4feb-a527-ea6e9fb92bcb tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:11 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8" returned: 0 in 0.940s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:11 devstack cinder-volume[87586]: DEBUG cinder.utils [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Path /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8 not found in is_blk_device check {{(pid=87586) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:03:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:11 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8 Jul 07 22:03:11 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:16 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8" returned: 0 in 5.809s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:16 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba32c497-dac6-4f2c-8674-a5c63e257a36]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:03:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:17 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 Jul 07 22:03:17 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:17 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8" returned: 0 in 1.015s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:17 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Image conversion details: src /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8, size 1024.00 MB, duration 5.81 sec, destination /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8 {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:03:17 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Converted 1024.00 MB image at 176.23 MB/s Jul 07 22:03:17 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8 is being set with open permissions: ugo+rw Jul 07 22:03:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:17 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8 Jul 07 22:03:17 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:18 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8" returned: 0 in 0.741s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8" released by "_copy_volume_from_snapshot" :: held 9.536s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-6eca9646-32e8-4567-a030-957497dbc88d-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8" released by "_create_volume_from_snapshot" :: held 9.589s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.638s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d7ffb0ed-ff6f-4feb-a527-ea6e9fb92bcb tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.052s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-d7ffb0ed-ff6f-4feb-a527-ea6e9fb92bcb tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Creating offline snapshot 36828edd-3636-442a-9f05-7beea1dead54 of volume e9d7450e-a12b-4a50-9557-ef666230be48 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:03:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d407037f-6477-4379-a52a-f0583c6b3fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8', 'volume_size': 2, 'snapshot_id': '6eca9646-32e8-4567-a030-957497dbc88d'}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269683b6-2bcd-430b-a427-86be594e6ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:18 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d8c79e-2bee-4569-93b6-e02d242746b9]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:03:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d7ffb0ed-ff6f-4feb-a527-ea6e9fb92bcb tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:18 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Volume volume-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8 (78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8): created successfully Jul 07 22:03:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269683b6-2bcd-430b-a427-86be594e6ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Flow 'volume_create_manager' (ba1473e2-2f3f-4736-8b7e-23ecd9377670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:03:18 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-2d7d9470-a32c-43e6-8f7d-65d353a411cb tempest-VolumesSnapshotTestJSON-1830172248 None] Created volume successfully. Jul 07 22:03:18 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48 Jul 07 22:03:18 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ca02fd72-cc39-4218-98a9-f9b61fd80acf tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ca02fd72-cc39-4218-98a9-f9b61fd80acf tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:19 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d7ffb0ed-ff6f-4feb-a527-ea6e9fb92bcb tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48" returned: 0 in 1.052s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d7ffb0ed-ff6f-4feb-a527-ea6e9fb92bcb tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.36828edd-3636-442a-9f05-7beea1dead54 2G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:19 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.36828edd-3636-442a-9f05-7beea1dead54 2G Jul 07 22:03:19 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ca02fd72-cc39-4218-98a9-f9b61fd80acf tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-quobyte-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ca02fd72-cc39-4218-98a9-f9b61fd80acf tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8" acquired by "delete_volume" :: waited 0.022s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:19 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7fea65-1a80-4087-841a-3349011a70a6]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:03:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ca02fd72-cc39-4218-98a9-f9b61fd80acf tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:20 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8 Jul 07 22:03:20 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:20 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ca02fd72-cc39-4218-98a9-f9b61fd80acf tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8" returned: 0 in 0.909s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ca02fd72-cc39-4218-98a9-f9b61fd80acf tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:20 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8 Jul 07 22:03:20 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:21 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d7ffb0ed-ff6f-4feb-a527-ea6e9fb92bcb tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.36828edd-3636-442a-9f05-7beea1dead54 2G" returned: 0 in 1.377s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d7ffb0ed-ff6f-4feb-a527-ea6e9fb92bcb tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9d7450e-a12b-4a50-9557-ef666230be48 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.36828edd-3636-442a-9f05-7beea1dead54 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:21 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9d7450e-a12b-4a50-9557-ef666230be48 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.36828edd-3636-442a-9f05-7beea1dead54 Jul 07 22:03:21 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:21 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:03:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Flow 'volume_create_manager' (033adad7-e904-4527-aec5-49fbe7b949e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:03:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe9ebfd-80d9-4a66-af06-c9080ff965cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe9ebfd-80d9-4a66-af06-c9080ff965cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2016782045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4a71ea-9614-4dbf-abaa-77fde8c75934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee773b3c1af476683f237bb52ab5d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:03:22Z,use_quota=True,user_id='5378d1454bf041a59d97d1a3431e1cc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a2cf5d-36c4-46c9-be95-b711803d1070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:21 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a2cf5d-36c4-46c9-be95-b711803d1070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162666ea-4903-45e8-96f5-c0b8082ff963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162666ea-4903-45e8-96f5-c0b8082ff963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c4a71ea-9614-4dbf-abaa-77fde8c75934', 'volume_name': 'volume-7c4a71ea-9614-4dbf-abaa-77fde8c75934', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d820af3-f2b5-4a09-a0bd-618c26d57cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d820af3-f2b5-4a09-a0bd-618c26d57cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde6d99d-a49a-4c51-beb7-489c7d67a42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:21 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Volume 7c4a71ea-9614-4dbf-abaa-77fde8c75934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c4a71ea-9614-4dbf-abaa-77fde8c75934', 'volume_size': 1} Jul 07 22:03:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ca02fd72-cc39-4218-98a9-f9b61fd80acf tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8" returned: 0 in 1.076s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:21 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ca02fd72-cc39-4218-98a9-f9b61fd80acf tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8" released by "delete_volume" :: held 2.044s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:22 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-ca02fd72-cc39-4218-98a9-f9b61fd80acf tempest-VolumesSnapshotTestJSON-1830172248 None] Created reservations ['e79f995a-fb33-498a-9f34-d9cefdf80553', '1d720601-7114-4d85-8b1f-519aac0db720', 'a286d539-1fbe-4d19-90ee-d8ce8dd951a0', '5004ee87-048f-4e1f-9e85-ac795a68b8b9'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:03:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ca02fd72-cc39-4218-98a9-f9b61fd80acf tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ca02fd72-cc39-4218-98a9-f9b61fd80acf tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ca02fd72-cc39-4218-98a9-f9b61fd80acf tempest-VolumesSnapshotTestJSON-1830172248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:03:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ca02fd72-cc39-4218-98a9-f9b61fd80acf tempest-VolumesSnapshotTestJSON-1830172248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:03:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ca02fd72-cc39-4218-98a9-f9b61fd80acf tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ca02fd72-cc39-4218-98a9-f9b61fd80acf tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:22 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:03:22 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:22 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d7ffb0ed-ff6f-4feb-a527-ea6e9fb92bcb tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9d7450e-a12b-4a50-9557-ef666230be48 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.36828edd-3636-442a-9f05-7beea1dead54" returned: 0 in 1.120s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:22 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-d7ffb0ed-ff6f-4feb-a527-ea6e9fb92bcb tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.36828edd-3636-442a-9f05-7beea1dead54 is being set with open permissions: ugo+rw Jul 07 22:03:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d7ffb0ed-ff6f-4feb-a527-ea6e9fb92bcb tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.36828edd-3636-442a-9f05-7beea1dead54 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:22 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.36828edd-3636-442a-9f05-7beea1dead54 Jul 07 22:03:22 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:22 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ca02fd72-cc39-4218-98a9-f9b61fd80acf tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.809s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:22 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-ca02fd72-cc39-4218-98a9-f9b61fd80acf tempest-VolumesSnapshotTestJSON-1830172248 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:03:22 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ca02fd72-cc39-4218-98a9-f9b61fd80acf tempest-VolumesSnapshotTestJSON-1830172248 None] Deleted volume successfully. Jul 07 22:03:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ca02fd72-cc39-4218-98a9-f9b61fd80acf tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-78e84e7f-e11f-4d8d-88ed-8a6aaecbdac8-delete_volume" released by "delete_volume" :: held 3.140s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:23 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d7ffb0ed-ff6f-4feb-a527-ea6e9fb92bcb tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.36828edd-3636-442a-9f05-7beea1dead54" returned: 0 in 0.775s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d7ffb0ed-ff6f-4feb-a527-ea6e9fb92bcb tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:23 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.info Jul 07 22:03:23 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:23 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54702e3d-10b0-4231-9f38-e408efd1b074 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-6eca9646-32e8-4567-a030-957497dbc88d-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:23 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54702e3d-10b0-4231-9f38-e408efd1b074 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-6eca9646-32e8-4567-a030-957497dbc88d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:23 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54702e3d-10b0-4231-9f38-e408efd1b074 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-quobyte-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:23 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54702e3d-10b0-4231-9f38-e408efd1b074 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:23 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54702e3d-10b0-4231-9f38-e408efd1b074 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-quobyte-6eca9646-32e8-4567-a030-957497dbc88d" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:23 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54702e3d-10b0-4231-9f38-e408efd1b074 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-6eca9646-32e8-4567-a030-957497dbc88d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-54702e3d-10b0-4231-9f38-e408efd1b074 tempest-VolumesSnapshotTestJSON-1830172248 None] Deleting offline snapshot 6eca9646-32e8-4567-a030-957497dbc88d of volume afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:03:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-54702e3d-10b0-4231-9f38-e408efd1b074 tempest-VolumesSnapshotTestJSON-1830172248 None] snapshot_file for this snap is: volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:03:23 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[39efad15-a6be-448a-9754-94bb8eaf3596]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:03:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54702e3d-10b0-4231-9f38-e408efd1b074 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:23 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d Jul 07 22:03:23 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:23 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d7ffb0ed-ff6f-4feb-a527-ea6e9fb92bcb tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.info" returned: 0 in 0.692s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:23 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-d7ffb0ed-ff6f-4feb-a527-ea6e9fb92bcb tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.info is being set with open permissions: ugo+rw Jul 07 22:03:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d7ffb0ed-ff6f-4feb-a527-ea6e9fb92bcb tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:23 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.info Jul 07 22:03:23 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:24 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54702e3d-10b0-4231-9f38-e408efd1b074 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d" returned: 0 in 0.829s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-54702e3d-10b0-4231-9f38-e408efd1b074 tempest-VolumesSnapshotTestJSON-1830172248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:03:24 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f29516-043c-4bc7-93f5-5ae64244d679]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:03:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54702e3d-10b0-4231-9f38-e408efd1b074 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:24 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 Jul 07 22:03:24 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:24 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d7ffb0ed-ff6f-4feb-a527-ea6e9fb92bcb tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.info" returned: 0 in 0.727s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d7ffb0ed-ff6f-4feb-a527-ea6e9fb92bcb tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.887s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.681s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2016782045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4a71ea-9614-4dbf-abaa-77fde8c75934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee773b3c1af476683f237bb52ab5d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:03:22Z,use_quota=True,user_id='5378d1454bf041a59d97d1a3431e1cc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:03:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Creating volume 7c4a71ea-9614-4dbf-abaa-77fde8c75934 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:03:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:03:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:03:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:03:24 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:03:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c4a71ea-9614-4dbf-abaa-77fde8c75934 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:24 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d7ffb0ed-ff6f-4feb-a527-ea6e9fb92bcb tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Create snapshot completed successfully Jul 07 22:03:24 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c4a71ea-9614-4dbf-abaa-77fde8c75934 1073741824 Jul 07 22:03:24 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:25 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54702e3d-10b0-4231-9f38-e408efd1b074 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8" returned: 0 in 0.852s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54702e3d-10b0-4231-9f38-e408efd1b074 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:25 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d Jul 07 22:03:25 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:25 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c4a71ea-9614-4dbf-abaa-77fde8c75934 1073741824" returned: 0 in 0.954s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c4a71ea-9614-4dbf-abaa-77fde8c75934 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:25 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c4a71ea-9614-4dbf-abaa-77fde8c75934 Jul 07 22:03:25 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c463149b-f5dd-426f-b7b3-b4c07949f509 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Acquiring lock "cinder-36828edd-3636-442a-9f05-7beea1dead54-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c463149b-f5dd-426f-b7b3-b4c07949f509 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Lock "cinder-36828edd-3636-442a-9f05-7beea1dead54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c463149b-f5dd-426f-b7b3-b4c07949f509 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Acquiring lock "cinder-quobyte-e9d7450e-a12b-4a50-9557-ef666230be48" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c463149b-f5dd-426f-b7b3-b4c07949f509 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Lock "cinder-quobyte-e9d7450e-a12b-4a50-9557-ef666230be48" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c463149b-f5dd-426f-b7b3-b4c07949f509 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Acquiring lock "cinder-quobyte-36828edd-3636-442a-9f05-7beea1dead54" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c463149b-f5dd-426f-b7b3-b4c07949f509 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Lock "cinder-quobyte-36828edd-3636-442a-9f05-7beea1dead54" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-c463149b-f5dd-426f-b7b3-b4c07949f509 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Deleting offline snapshot 36828edd-3636-442a-9f05-7beea1dead54 of volume e9d7450e-a12b-4a50-9557-ef666230be48 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:03:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-c463149b-f5dd-426f-b7b3-b4c07949f509 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] snapshot_file for this snap is: volume-e9d7450e-a12b-4a50-9557-ef666230be48.36828edd-3636-442a-9f05-7beea1dead54 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:03:25 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f76a53-ee54-42c4-9690-0c641d192de9]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:03:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c463149b-f5dd-426f-b7b3-b4c07949f509 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.36828edd-3636-442a-9f05-7beea1dead54 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:25 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.36828edd-3636-442a-9f05-7beea1dead54 Jul 07 22:03:25 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:26 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54702e3d-10b0-4231-9f38-e408efd1b074 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d" returned: 0 in 0.936s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54702e3d-10b0-4231-9f38-e408efd1b074 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:26 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d Jul 07 22:03:26 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:26 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c4a71ea-9614-4dbf-abaa-77fde8c75934" returned: 0 in 0.857s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:03:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde6d99d-a49a-4c51-beb7-489c7d67a42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c4a71ea-9614-4dbf-abaa-77fde8c75934', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1dcaf55-3c58-42b7-8546-eed4c530791c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:26 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Volume volume-7c4a71ea-9614-4dbf-abaa-77fde8c75934 (7c4a71ea-9614-4dbf-abaa-77fde8c75934): created successfully Jul 07 22:03:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1dcaf55-3c58-42b7-8546-eed4c530791c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Flow 'volume_create_manager' (033adad7-e904-4527-aec5-49fbe7b949e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:03:26 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-9e44bdac-621a-4fe0-88ac-82c372d7f82b tempest-VolumesTransfersV355Test-1226059077 None] Created volume successfully. Jul 07 22:03:26 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c463149b-f5dd-426f-b7b3-b4c07949f509 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.36828edd-3636-442a-9f05-7beea1dead54" returned: 0 in 0.859s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-c463149b-f5dd-426f-b7b3-b4c07949f509 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9d7450e-a12b-4a50-9557-ef666230be48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:03:26 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[accdb7e0-7b81-433b-9f79-59f8519e2c67]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:03:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c463149b-f5dd-426f-b7b3-b4c07949f509 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:26 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48 Jul 07 22:03:26 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:26 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-54702e3d-10b0-4231-9f38-e408efd1b074 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8.6eca9646-32e8-4567-a030-957497dbc88d" returned: 0 in 0.799s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:26 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54702e3d-10b0-4231-9f38-e408efd1b074 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-6eca9646-32e8-4567-a030-957497dbc88d" released by "_delete_snapshot" :: held 3.548s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:26 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54702e3d-10b0-4231-9f38-e408efd1b074 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8" released by "delete_snapshot" :: held 3.575s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:26 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-54702e3d-10b0-4231-9f38-e408efd1b074 tempest-VolumesSnapshotTestJSON-1830172248 None] Created reservations ['092cace3-73be-44d2-a6cf-169e5f95968e', 'a002563c-e7dc-4ac8-8c9c-9f3cf2c3c4e7', 'd37cba1f-bc07-4964-ab2e-a0736ea82ce0', 'da8eeb70-b702-4b35-be23-478830bc7a68'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:03:26 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-54702e3d-10b0-4231-9f38-e408efd1b074 tempest-VolumesSnapshotTestJSON-1830172248 None] Delete snapshot completed successfully. Jul 07 22:03:26 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-54702e3d-10b0-4231-9f38-e408efd1b074 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-6eca9646-32e8-4567-a030-957497dbc88d-delete_snapshot" released by "delete_snapshot" :: held 3.705s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:27 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c463149b-f5dd-426f-b7b3-b4c07949f509 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48" returned: 0 in 0.873s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c463149b-f5dd-426f-b7b3-b4c07949f509 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.36828edd-3636-442a-9f05-7beea1dead54 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:27 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.36828edd-3636-442a-9f05-7beea1dead54 Jul 07 22:03:27 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-56105939-8cf9-4350-9b6d-4bae61886e69 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-56105939-8cf9-4350-9b6d-4bae61886e69 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-56105939-8cf9-4350-9b6d-4bae61886e69 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-quobyte-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-56105939-8cf9-4350-9b6d-4bae61886e69 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8" acquired by "delete_volume" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:27 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a23af9-31fd-4783-ba66-0d1da985f100]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:03:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56105939-8cf9-4350-9b6d-4bae61886e69 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:27 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-1e3db06c-d029-4655-a450-635399474728 tempest-VolumesTransfersV355Test-1099906805 None] Transfer volume completed successfully. Jul 07 22:03:27 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 Jul 07 22:03:27 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:28 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c463149b-f5dd-426f-b7b3-b4c07949f509 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.36828edd-3636-442a-9f05-7beea1dead54" returned: 0 in 0.856s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c463149b-f5dd-426f-b7b3-b4c07949f509 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.36828edd-3636-442a-9f05-7beea1dead54 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:28 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.36828edd-3636-442a-9f05-7beea1dead54 Jul 07 22:03:28 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:28 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56105939-8cf9-4350-9b6d-4bae61886e69 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8" returned: 0 in 0.950s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56105939-8cf9-4350-9b6d-4bae61886e69 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:28 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8 Jul 07 22:03:28 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c3b1ed30-b8cb-4fba-ae3d-caa841f1bc70 tempest-VolumesTransfersV355Test-768351723 None] Acquiring lock "cinder-7c4a71ea-9614-4dbf-abaa-77fde8c75934-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c3b1ed30-b8cb-4fba-ae3d-caa841f1bc70 tempest-VolumesTransfersV355Test-768351723 None] Lock "cinder-7c4a71ea-9614-4dbf-abaa-77fde8c75934-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c3b1ed30-b8cb-4fba-ae3d-caa841f1bc70 tempest-VolumesTransfersV355Test-768351723 None] Acquiring lock "cinder-quobyte-7c4a71ea-9614-4dbf-abaa-77fde8c75934" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c3b1ed30-b8cb-4fba-ae3d-caa841f1bc70 tempest-VolumesTransfersV355Test-768351723 None] Lock "cinder-quobyte-7c4a71ea-9614-4dbf-abaa-77fde8c75934" acquired by "delete_volume" :: waited 0.022s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:29 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c830649b-b2d5-4515-ba04-9b9131716a79]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:03:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c3b1ed30-b8cb-4fba-ae3d-caa841f1bc70 tempest-VolumesTransfersV355Test-768351723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c4a71ea-9614-4dbf-abaa-77fde8c75934 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:29 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c4a71ea-9614-4dbf-abaa-77fde8c75934 Jul 07 22:03:29 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:29 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c463149b-f5dd-426f-b7b3-b4c07949f509 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48.36828edd-3636-442a-9f05-7beea1dead54" returned: 0 in 0.844s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c463149b-f5dd-426f-b7b3-b4c07949f509 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Lock "cinder-quobyte-36828edd-3636-442a-9f05-7beea1dead54" released by "_delete_snapshot" :: held 3.542s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c463149b-f5dd-426f-b7b3-b4c07949f509 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Lock "cinder-quobyte-e9d7450e-a12b-4a50-9557-ef666230be48" released by "delete_snapshot" :: held 3.566s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:29 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-c463149b-f5dd-426f-b7b3-b4c07949f509 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Created reservations ['21893e18-b340-4af5-ba60-78422ce25b23', 'f08ed79f-dd66-41b2-a7c1-67e17479296e', '9678e228-8182-4991-9bcc-4a57b3fbcbc8', '669b2bcf-fa1e-46ea-9c7f-1f7ab770a2da'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:03:29 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-c463149b-f5dd-426f-b7b3-b4c07949f509 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Delete snapshot completed successfully. Jul 07 22:03:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c463149b-f5dd-426f-b7b3-b4c07949f509 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Lock "cinder-36828edd-3636-442a-9f05-7beea1dead54-delete_snapshot" released by "delete_snapshot" :: held 3.710s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:29 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56105939-8cf9-4350-9b6d-4bae61886e69 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8" returned: 0 in 0.758s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-56105939-8cf9-4350-9b6d-4bae61886e69 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8" released by "delete_volume" :: held 1.789s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:29 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-56105939-8cf9-4350-9b6d-4bae61886e69 tempest-VolumesSnapshotTestJSON-1830172248 None] Created reservations ['000e0970-9073-45d6-879f-bd22c5f3341c', '785d18e5-dd4a-4c14-8c88-365721eb107c', 'b1f38768-9fb4-4067-a0e1-8a801952481e', '328a5287-c168-4cb8-bd8b-a1708683ae38'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:03:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-56105939-8cf9-4350-9b6d-4bae61886e69 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-56105939-8cf9-4350-9b6d-4bae61886e69 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:29 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-56105939-8cf9-4350-9b6d-4bae61886e69 tempest-VolumesSnapshotTestJSON-1830172248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:03:29 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-56105939-8cf9-4350-9b6d-4bae61886e69 tempest-VolumesSnapshotTestJSON-1830172248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:03:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-56105939-8cf9-4350-9b6d-4bae61886e69 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56105939-8cf9-4350-9b6d-4bae61886e69 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:29 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:03:29 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:29 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c3b1ed30-b8cb-4fba-ae3d-caa841f1bc70 tempest-VolumesTransfersV355Test-768351723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c4a71ea-9614-4dbf-abaa-77fde8c75934" returned: 0 in 0.855s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c3b1ed30-b8cb-4fba-ae3d-caa841f1bc70 tempest-VolumesTransfersV355Test-768351723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c4a71ea-9614-4dbf-abaa-77fde8c75934 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:29 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c4a71ea-9614-4dbf-abaa-77fde8c75934 Jul 07 22:03:29 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6fd11985-a906-4ac1-9e36-34ef480905e6 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Acquiring lock "cinder-e9d7450e-a12b-4a50-9557-ef666230be48-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6fd11985-a906-4ac1-9e36-34ef480905e6 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Lock "cinder-e9d7450e-a12b-4a50-9557-ef666230be48-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6fd11985-a906-4ac1-9e36-34ef480905e6 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Acquiring lock "cinder-quobyte-e9d7450e-a12b-4a50-9557-ef666230be48" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6fd11985-a906-4ac1-9e36-34ef480905e6 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Lock "cinder-quobyte-e9d7450e-a12b-4a50-9557-ef666230be48" acquired by "delete_volume" :: waited 0.029s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c848524-af29-4d2e-9ae8-3f954cc924c4]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6fd11985-a906-4ac1-9e36-34ef480905e6 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:30 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48 Jul 07 22:03:30 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:30 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56105939-8cf9-4350-9b6d-4bae61886e69 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.921s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-56105939-8cf9-4350-9b6d-4bae61886e69 tempest-VolumesSnapshotTestJSON-1830172248 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:03:30 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-56105939-8cf9-4350-9b6d-4bae61886e69 tempest-VolumesSnapshotTestJSON-1830172248 None] Deleted volume successfully. Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Flow 'volume_create_manager' (7986d823-bb05-4bf2-bb79-349c170205cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f0e1e1-8bdc-4462-b538-13e127a35645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-56105939-8cf9-4350-9b6d-4bae61886e69 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-afd6bbd4-d935-4fdb-81c7-5ba2fd29e1e8-delete_volume" released by "delete_volume" :: held 2.959s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52f0e1e1-8bdc-4462-b538-13e127a35645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-669370619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a723777-599f-425a-ba87-fc900f320fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2134704110b4381b38e4e2a19049750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:03:31Z,use_quota=True,user_id='5ad0c11f603a458cb92dd5ec16514961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1159aedc-88f4-4017-b028-367bf7d7aa60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1159aedc-88f4-4017-b028-367bf7d7aa60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1889803-dc78-487a-9640-d884be1b6a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1889803-dc78-487a-9640-d884be1b6a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a723777-599f-425a-ba87-fc900f320fa9', 'volume_name': 'volume-0a723777-599f-425a-ba87-fc900f320fa9', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d076a7c-df78-4e06-871e-b44b56620145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d076a7c-df78-4e06-871e-b44b56620145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58aef5d4-b602-4de2-8be5-c7c759834ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:30 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Volume 0a723777-599f-425a-ba87-fc900f320fa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a723777-599f-425a-ba87-fc900f320fa9', 'volume_size': 1} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-669370619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a723777-599f-425a-ba87-fc900f320fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2134704110b4381b38e4e2a19049750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:03:31Z,use_quota=True,user_id='5ad0c11f603a458cb92dd5ec16514961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Creating volume 0a723777-599f-425a-ba87-fc900f320fa9 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:03:30 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:30 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9 1073741824 Jul 07 22:03:30 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:30 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c3b1ed30-b8cb-4fba-ae3d-caa841f1bc70 tempest-VolumesTransfersV355Test-768351723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c4a71ea-9614-4dbf-abaa-77fde8c75934" returned: 0 in 0.928s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c3b1ed30-b8cb-4fba-ae3d-caa841f1bc70 tempest-VolumesTransfersV355Test-768351723 None] Lock "cinder-quobyte-7c4a71ea-9614-4dbf-abaa-77fde8c75934" released by "delete_volume" :: held 1.848s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:30 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-c3b1ed30-b8cb-4fba-ae3d-caa841f1bc70 tempest-VolumesTransfersV355Test-768351723 None] Created reservations ['a1404705-9b86-466b-b225-fb087e4afb40', 'c774e030-27b8-4e4f-ac79-007282fc9a05', '8407dcbb-5def-4f7e-92cf-3e66e9a9b7ba', '6d25dca4-67b2-4bf9-a54f-112bd4f5305f'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:03:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c3b1ed30-b8cb-4fba-ae3d-caa841f1bc70 tempest-VolumesTransfersV355Test-768351723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c3b1ed30-b8cb-4fba-ae3d-caa841f1bc70 tempest-VolumesTransfersV355Test-768351723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c3b1ed30-b8cb-4fba-ae3d-caa841f1bc70 tempest-VolumesTransfersV355Test-768351723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:03:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c3b1ed30-b8cb-4fba-ae3d-caa841f1bc70 tempest-VolumesTransfersV355Test-768351723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:03:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c3b1ed30-b8cb-4fba-ae3d-caa841f1bc70 tempest-VolumesTransfersV355Test-768351723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c3b1ed30-b8cb-4fba-ae3d-caa841f1bc70 tempest-VolumesTransfersV355Test-768351723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:31 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:03:31 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:31 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6fd11985-a906-4ac1-9e36-34ef480905e6 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48" returned: 0 in 0.944s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6fd11985-a906-4ac1-9e36-34ef480905e6 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:31 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48 Jul 07 22:03:31 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:31 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9 1073741824" returned: 0 in 1.126s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:31 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c3b1ed30-b8cb-4fba-ae3d-caa841f1bc70 tempest-VolumesTransfersV355Test-768351723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.877s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:31 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c3b1ed30-b8cb-4fba-ae3d-caa841f1bc70 tempest-VolumesTransfersV355Test-768351723 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:03:31 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-c3b1ed30-b8cb-4fba-ae3d-caa841f1bc70 tempest-VolumesTransfersV355Test-768351723 None] Deleted volume successfully. Jul 07 22:03:31 devstack sudo[98030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9 Jul 07 22:03:31 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c3b1ed30-b8cb-4fba-ae3d-caa841f1bc70 tempest-VolumesTransfersV355Test-768351723 None] Lock "cinder-7c4a71ea-9614-4dbf-abaa-77fde8c75934-delete_volume" released by "delete_volume" :: held 3.040s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:03:32 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Flow 'volume_create_manager' (050c8cf8-0fa5-47e5-a92b-4e3761d6a1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef984f49-132d-4c07-89e8-e239aae22c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6fd11985-a906-4ac1-9e36-34ef480905e6 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e9d7450e-a12b-4a50-9557-ef666230be48" returned: 0 in 0.900s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6fd11985-a906-4ac1-9e36-34ef480905e6 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Lock "cinder-quobyte-e9d7450e-a12b-4a50-9557-ef666230be48" released by "delete_volume" :: held 1.940s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef984f49-132d-4c07-89e8-e239aae22c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-965987617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee773b3c1af476683f237bb52ab5d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:03:32Z,use_quota=True,user_id='5378d1454bf041a59d97d1a3431e1cc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0faef0f5-d956-4ed3-a295-251cafbbfbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0faef0f5-d956-4ed3-a295-251cafbbfbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f4de50-b484-4f9b-9112-1ab8d68fbdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f4de50-b484-4f9b-9112-1ab8d68fbdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd08faf45-a3a7-4d29-aa53-8b6f47a0e8fc', 'volume_name': 'volume-d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f9982d-2e32-4b30-9c2a-f9046fe3d3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f9982d-2e32-4b30-9c2a-f9046fe3d3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434ed887-f877-4858-83d3-1690b7d587fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:32 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Volume d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc', 'volume_size': 1} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-6fd11985-a906-4ac1-9e36-34ef480905e6 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Created reservations ['76096761-dfcc-4669-8c30-6ee8fc24615a', 'b7c2a709-0e19-48ea-b631-c4e3483a2793', '02aff495-6864-4548-be22-1f11a8eb09aa', '4f562717-fddd-4e63-ab5c-f0157e5a5722'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6fd11985-a906-4ac1-9e36-34ef480905e6 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6fd11985-a906-4ac1-9e36-34ef480905e6 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6fd11985-a906-4ac1-9e36-34ef480905e6 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6fd11985-a906-4ac1-9e36-34ef480905e6 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6fd11985-a906-4ac1-9e36-34ef480905e6 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6fd11985-a906-4ac1-9e36-34ef480905e6 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:32 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:03:32 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:32 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9" returned: 0 in 0.929s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] <== create_volume: return (2133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.135s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.631s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-965987617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee773b3c1af476683f237bb52ab5d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:03:32Z,use_quota=True,user_id='5378d1454bf041a59d97d1a3431e1cc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Creating volume d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:03:32 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58aef5d4-b602-4de2-8be5-c7c759834ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a723777-599f-425a-ba87-fc900f320fa9', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7162c4cd-87e1-4767-975a-9d532a4806bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:32 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc 1073741824 Jul 07 22:03:32 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:32 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Volume volume-0a723777-599f-425a-ba87-fc900f320fa9 (0a723777-599f-425a-ba87-fc900f320fa9): created successfully Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7162c4cd-87e1-4767-975a-9d532a4806bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Flow 'volume_create_manager' (7986d823-bb05-4bf2-bb79-349c170205cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:03:33 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-154be844-8948-40f4-bff0-66aece129bc7 tempest-VolumesSnapshotTestJSON-1830172248 None] Created volume successfully. Jul 07 22:03:33 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6fd11985-a906-4ac1-9e36-34ef480905e6 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.913s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:33 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-6fd11985-a906-4ac1-9e36-34ef480905e6 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:03:33 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6fd11985-a906-4ac1-9e36-34ef480905e6 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Deleted volume successfully. Jul 07 22:03:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6fd11985-a906-4ac1-9e36-34ef480905e6 tempest-VolumesSnapshotNegativeTestJSON-1716297873 None] Lock "cinder-e9d7450e-a12b-4a50-9557-ef666230be48-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:34 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc 1073741824" returned: 0 in 1.178s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-14bafb36-ed7d-4169-983c-9d1f45297cce tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:34 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc Jul 07 22:03:34 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:35 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc" returned: 0 in 0.858s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] <== create_volume: return (2165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:03:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.170s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-14bafb36-ed7d-4169-983c-9d1f45297cce tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.821s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-14bafb36-ed7d-4169-983c-9d1f45297cce tempest-VolumesSnapshotTestJSON-1830172248 None] Creating offline snapshot c1000cf5-d186-4577-8b92-d6c614eab9cd of volume 0a723777-599f-425a-ba87-fc900f320fa9 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:03:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434ed887-f877-4858-83d3-1690b7d587fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a8d184-5771-42b3-8d92-abc05c195c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:35 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[653876e5-7dbe-4d53-ba48-913fa5cd68d6]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:03:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-14bafb36-ed7d-4169-983c-9d1f45297cce tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:35 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Volume volume-d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc (d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc): created successfully Jul 07 22:03:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a8d184-5771-42b3-8d92-abc05c195c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Flow 'volume_create_manager' (050c8cf8-0fa5-47e5-a92b-4e3761d6a1dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:03:35 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-3f963b7a-5b3c-427f-957e-77289e1096f2 tempest-VolumesTransfersV355Test-1226059077 None] Created volume successfully. Jul 07 22:03:35 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9 Jul 07 22:03:35 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:03:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:03:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:03:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:35 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:03:35 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:35 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-14bafb36-ed7d-4169-983c-9d1f45297cce tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9" returned: 0 in 0.870s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-14bafb36-ed7d-4169-983c-9d1f45297cce tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:35 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd 1G Jul 07 22:03:35 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:36 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.842s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:03:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:03:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 28 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 22:03:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 22:03:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c4b51a79-ade2-4b95-a45e-83bcfc88da07 tempest-VolumesTransfersV355Test-768351723 None] Acquiring lock "cinder-d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c4b51a79-ade2-4b95-a45e-83bcfc88da07 tempest-VolumesTransfersV355Test-768351723 None] Lock "cinder-d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c4b51a79-ade2-4b95-a45e-83bcfc88da07 tempest-VolumesTransfersV355Test-768351723 None] Acquiring lock "cinder-quobyte-d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c4b51a79-ade2-4b95-a45e-83bcfc88da07 tempest-VolumesTransfersV355Test-768351723 None] Lock "cinder-quobyte-d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc" acquired by "delete_volume" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:36 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b1ea42-3b1e-4236-8fe5-63d206a88343]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:03:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c4b51a79-ade2-4b95-a45e-83bcfc88da07 tempest-VolumesTransfersV355Test-768351723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:36 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc Jul 07 22:03:36 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:36 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-14bafb36-ed7d-4169-983c-9d1f45297cce tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd 1G" returned: 0 in 1.067s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-14bafb36-ed7d-4169-983c-9d1f45297cce tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a723777-599f-425a-ba87-fc900f320fa9 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:37 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a723777-599f-425a-ba87-fc900f320fa9 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd Jul 07 22:03:37 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:37 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c4b51a79-ade2-4b95-a45e-83bcfc88da07 tempest-VolumesTransfersV355Test-768351723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc" returned: 0 in 0.965s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c4b51a79-ade2-4b95-a45e-83bcfc88da07 tempest-VolumesTransfersV355Test-768351723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:37 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc Jul 07 22:03:37 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:37 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-14bafb36-ed7d-4169-983c-9d1f45297cce tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a723777-599f-425a-ba87-fc900f320fa9 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd" returned: 0 in 0.862s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:37 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-14bafb36-ed7d-4169-983c-9d1f45297cce tempest-VolumesSnapshotTestJSON-1830172248 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd is being set with open permissions: ugo+rw Jul 07 22:03:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-14bafb36-ed7d-4169-983c-9d1f45297cce tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:37 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd Jul 07 22:03:37 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:38 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c4b51a79-ade2-4b95-a45e-83bcfc88da07 tempest-VolumesTransfersV355Test-768351723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc" returned: 0 in 0.756s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:38 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c4b51a79-ade2-4b95-a45e-83bcfc88da07 tempest-VolumesTransfersV355Test-768351723 None] Lock "cinder-quobyte-d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc" released by "delete_volume" :: held 1.779s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:38 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-14bafb36-ed7d-4169-983c-9d1f45297cce tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd" returned: 0 in 0.667s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:38 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-c4b51a79-ade2-4b95-a45e-83bcfc88da07 tempest-VolumesTransfersV355Test-768351723 None] Created reservations ['807be37c-e1e8-474a-8232-f4548c2e5b7d', '892f8e9a-c255-441f-b6f3-153edd90cd5e', '94563b35-c078-48a7-a530-0affc293f49a', '931d1639-8104-4aa4-9540-26be8516481e'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:03:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-14bafb36-ed7d-4169-983c-9d1f45297cce tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:38 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.info Jul 07 22:03:38 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c4b51a79-ade2-4b95-a45e-83bcfc88da07 tempest-VolumesTransfersV355Test-768351723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c4b51a79-ade2-4b95-a45e-83bcfc88da07 tempest-VolumesTransfersV355Test-768351723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:38 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c4b51a79-ade2-4b95-a45e-83bcfc88da07 tempest-VolumesTransfersV355Test-768351723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:03:38 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c4b51a79-ade2-4b95-a45e-83bcfc88da07 tempest-VolumesTransfersV355Test-768351723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:03:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c4b51a79-ade2-4b95-a45e-83bcfc88da07 tempest-VolumesTransfersV355Test-768351723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c4b51a79-ade2-4b95-a45e-83bcfc88da07 tempest-VolumesTransfersV355Test-768351723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:38 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:03:38 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:39 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-14bafb36-ed7d-4169-983c-9d1f45297cce tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.info" returned: 0 in 1.105s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:39 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-14bafb36-ed7d-4169-983c-9d1f45297cce tempest-VolumesSnapshotTestJSON-1830172248 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.info is being set with open permissions: ugo+rw Jul 07 22:03:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-14bafb36-ed7d-4169-983c-9d1f45297cce tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:39 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.info Jul 07 22:03:39 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:40 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c4b51a79-ade2-4b95-a45e-83bcfc88da07 tempest-VolumesTransfersV355Test-768351723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.363s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:40 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c4b51a79-ade2-4b95-a45e-83bcfc88da07 tempest-VolumesTransfersV355Test-768351723 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:03:40 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-c4b51a79-ade2-4b95-a45e-83bcfc88da07 tempest-VolumesTransfersV355Test-768351723 None] Deleted volume successfully. Jul 07 22:03:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c4b51a79-ade2-4b95-a45e-83bcfc88da07 tempest-VolumesTransfersV355Test-768351723 None] Lock "cinder-d08faf45-a3a7-4d29-aa53-8b6f47a0e8fc-delete_volume" released by "delete_volume" :: held 3.433s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:40 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-14bafb36-ed7d-4169-983c-9d1f45297cce tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.info" returned: 0 in 1.070s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-14bafb36-ed7d-4169-983c-9d1f45297cce tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.777s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:40 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-14bafb36-ed7d-4169-983c-9d1f45297cce tempest-VolumesSnapshotTestJSON-1830172248 None] Create snapshot completed successfully Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Flow 'volume_create_manager' (643d6902-3f50-4692-9aa5-aa1f8b618383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4212539f-62c2-43cb-9ef7-60c7a42096a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4212539f-62c2-43cb-9ef7-60c7a42096a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-693018747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa57060f-441f-4216-9e65-b2e67f0afd6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2134704110b4381b38e4e2a19049750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c1000cf5-d186-4577-8b92-d6c614eab9cd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:03:43Z,use_quota=True,user_id='5ad0c11f603a458cb92dd5ec16514961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c3ea55-d775-480f-b265-6932c229de56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c3ea55-d775-480f-b265-6932c229de56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a2b762b-f541-4351-a172-6b79d63977ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a2b762b-f541-4351-a172-6b79d63977ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fa57060f-441f-4216-9e65-b2e67f0afd6b', 'volume_name': 'volume-fa57060f-441f-4216-9e65-b2e67f0afd6b', 'volume_size': 1, 'snapshot_id': 'c1000cf5-d186-4577-8b92-d6c614eab9cd'}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd664566-6709-40c3-be4d-e3752ac09ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd664566-6709-40c3-be4d-e3752ac09ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef39f6f0-fae5-4005-a3ff-7e9ba855afb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:42 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Volume fa57060f-441f-4216-9e65-b2e67f0afd6b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fa57060f-441f-4216-9e65-b2e67f0afd6b', 'volume_size': 1, 'snapshot_id': 'c1000cf5-d186-4577-8b92-d6c614eab9cd'} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-quobyte-c1000cf5-d186-4577-8b92-d6c614eab9cd-fa57060f-441f-4216-9e65-b2e67f0afd6b" by "_create_volume_from_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-c1000cf5-d186-4577-8b92-d6c614eab9cd-fa57060f-441f-4216-9e65-b2e67f0afd6b" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Creating volume fa57060f-441f-4216-9e65-b2e67f0afd6b from snapshot c1000cf5-d186-4577-8b92-d6c614eab9cd {{(pid=87586) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-quobyte-fa57060f-441f-4216-9e65-b2e67f0afd6b" by "_copy_volume_from_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-fa57060f-441f-4216-9e65-b2e67f0afd6b" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] snapshot: c1000cf5-d186-4577-8b92-d6c614eab9cd, volume: fa57060f-441f-4216-9e65-b2e67f0afd6b, {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf421fb-a6a5-430a-8039-bbf80e5a1230]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:03:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:43 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd Jul 07 22:03:43 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:44 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd" returned: 0 in 1.590s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:44 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a723777-599f-425a-ba87-fc900f320fa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:03:44 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9 {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:03:44 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Creating direct copy from snapshot {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:03:44 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3895b2f4-06ac-483c-98b8-a2bd64d7b484]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:03:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:44 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9 Jul 07 22:03:44 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:45 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=119,cinder:UPDATE=134,cinder:DELETE=14,cinder:INSERT=33 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:03:45 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:UPDATE=140,cinder:SELECT=103,cinder:INSERT=35,cinder:DELETE=10 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:03:45 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:03:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Flow 'volume_create_manager' (72c0eccd-f3c6-4234-86ea-0ee1c5500b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:03:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8f8efe-3c6b-4fa3-b273-a3771bd6daab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:45 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8f8efe-3c6b-4fa3-b273-a3771bd6daab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1012220757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd5d410e-3e40-4fd9-8739-503cfc7aab65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84800c3ec4a49079e964460ba092274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:03:46Z,use_quota=True,user_id='a58819f043f14c9790b7acfd4d627c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04cbfbe3-ace5-4485-b9eb-8ae5e704f164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04cbfbe3-ace5-4485-b9eb-8ae5e704f164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1371b8d1-72f2-4203-87ca-df10a6e3376b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1371b8d1-72f2-4203-87ca-df10a6e3376b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd5d410e-3e40-4fd9-8739-503cfc7aab65', 'volume_name': 'volume-fd5d410e-3e40-4fd9-8739-503cfc7aab65', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e74c92-26b3-467b-9e8c-dceab9f3394d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e74c92-26b3-467b-9e8c-dceab9f3394d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2069218-14aa-4042-bd29-3f1b37802bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:46 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Volume fd5d410e-3e40-4fd9-8739-503cfc7aab65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd5d410e-3e40-4fd9-8739-503cfc7aab65', 'volume_size': 1} Jul 07 22:03:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9" returned: 0 in 1.480s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:46 devstack cinder-volume[87586]: DEBUG cinder.utils [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Path /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fa57060f-441f-4216-9e65-b2e67f0afd6b not found in is_blk_device check {{(pid=87586) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:03:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fa57060f-441f-4216-9e65-b2e67f0afd6b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:46 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fa57060f-441f-4216-9e65-b2e67f0afd6b Jul 07 22:03:46 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:53 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fa57060f-441f-4216-9e65-b2e67f0afd6b" returned: 0 in 7.285s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:53 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f928ad66-8690-40e2-a428-c48ab8f415e3]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:03:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:53 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:03:53 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9 Jul 07 22:03:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Flow 'volume_create_manager' (b5cedd4c-fedc-4aba-99f5-240596c71e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:03:53 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dffa44b-0807-4a12-aeaa-9f6650e9ca49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dffa44b-0807-4a12-aeaa-9f6650e9ca49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-134261152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd59cb21-e450-45ab-853c-7eb50dc448f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aba001d67a5a48d29d9a944aa87d24c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:03:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:03:53Z,use_quota=True,user_id='f395312962fe480e8326ea7ad1c30368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5164ba0d-880e-4dd4-b0cc-c34e671a9489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5164ba0d-880e-4dd4-b0cc-c34e671a9489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0bbf9bc-aa33-4705-820c-244b2b784926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0bbf9bc-aa33-4705-820c-244b2b784926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd59cb21-e450-45ab-853c-7eb50dc448f9', 'volume_name': 'volume-dd59cb21-e450-45ab-853c-7eb50dc448f9', 'volume_size': 2}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1d212a-241b-446c-8cd4-316685fe87e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1d212a-241b-446c-8cd4-316685fe87e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b438dd-e6d4-4580-a613-a323ae13f7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:53 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Volume dd59cb21-e450-45ab-853c-7eb50dc448f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd59cb21-e450-45ab-853c-7eb50dc448f9', 'volume_size': 2} Jul 07 22:03:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:54 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9" returned: 0 in 1.184s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:54 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Image conversion details: src /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9, size 1024.00 MB, duration 7.29 sec, destination /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fa57060f-441f-4216-9e65-b2e67f0afd6b {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:03:54 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Converted 1024.00 MB image at 140.54 MB/s Jul 07 22:03:54 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fa57060f-441f-4216-9e65-b2e67f0afd6b is being set with open permissions: ugo+rw Jul 07 22:03:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fa57060f-441f-4216-9e65-b2e67f0afd6b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:54 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fa57060f-441f-4216-9e65-b2e67f0afd6b Jul 07 22:03:54 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:55 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fa57060f-441f-4216-9e65-b2e67f0afd6b" returned: 0 in 0.654s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:55 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-fa57060f-441f-4216-9e65-b2e67f0afd6b" released by "_copy_volume_from_snapshot" :: held 12.370s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:55 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-c1000cf5-d186-4577-8b92-d6c614eab9cd-fa57060f-441f-4216-9e65-b2e67f0afd6b" released by "_create_volume_from_snapshot" :: held 12.424s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.450s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.201s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1012220757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd5d410e-3e40-4fd9-8739-503cfc7aab65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84800c3ec4a49079e964460ba092274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:03:46Z,use_quota=True,user_id='a58819f043f14c9790b7acfd4d627c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:03:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Creating volume fd5d410e-3e40-4fd9-8739-503cfc7aab65 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:03:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:03:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:03:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:03:55 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:03:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd5d410e-3e40-4fd9-8739-503cfc7aab65 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:55 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd5d410e-3e40-4fd9-8739-503cfc7aab65 1073741824 Jul 07 22:03:55 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef39f6f0-fae5-4005-a3ff-7e9ba855afb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa57060f-441f-4216-9e65-b2e67f0afd6b', 'volume_size': 1, 'snapshot_id': 'c1000cf5-d186-4577-8b92-d6c614eab9cd'}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce78a79-e254-42d5-b2d9-186f263bdeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:55 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Volume volume-fa57060f-441f-4216-9e65-b2e67f0afd6b (fa57060f-441f-4216-9e65-b2e67f0afd6b): created successfully Jul 07 22:03:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce78a79-e254-42d5-b2d9-186f263bdeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Flow 'volume_create_manager' (643d6902-3f50-4692-9aa5-aa1f8b618383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:03:55 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-1e7d9307-5555-4e46-b6b0-9a62d5eed255 tempest-VolumesSnapshotTestJSON-1830172248 None] Created volume successfully. Jul 07 22:03:56 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd5d410e-3e40-4fd9-8739-503cfc7aab65 1073741824" returned: 0 in 1.077s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd5d410e-3e40-4fd9-8739-503cfc7aab65 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:56 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd5d410e-3e40-4fd9-8739-503cfc7aab65 Jul 07 22:03:56 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-72ceb87f-e33a-4935-8cdf-8f77681eff2e tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-fa57060f-441f-4216-9e65-b2e67f0afd6b-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-72ceb87f-e33a-4935-8cdf-8f77681eff2e tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-fa57060f-441f-4216-9e65-b2e67f0afd6b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-72ceb87f-e33a-4935-8cdf-8f77681eff2e tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-quobyte-fa57060f-441f-4216-9e65-b2e67f0afd6b" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-72ceb87f-e33a-4935-8cdf-8f77681eff2e tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-fa57060f-441f-4216-9e65-b2e67f0afd6b" acquired by "delete_volume" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:56 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9176775b-03cb-47be-9c8a-5cb30da14377]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:03:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-72ceb87f-e33a-4935-8cdf-8f77681eff2e tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fa57060f-441f-4216-9e65-b2e67f0afd6b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:56 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fa57060f-441f-4216-9e65-b2e67f0afd6b Jul 07 22:03:56 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:57 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd5d410e-3e40-4fd9-8739-503cfc7aab65" returned: 0 in 0.808s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:03:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.528s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-134261152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd59cb21-e450-45ab-853c-7eb50dc448f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aba001d67a5a48d29d9a944aa87d24c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:03:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:03:53Z,use_quota=True,user_id='f395312962fe480e8326ea7ad1c30368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:03:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Creating volume dd59cb21-e450-45ab-853c-7eb50dc448f9 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:03:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:03:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:03:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:03:57 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:03:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd59cb21-e450-45ab-853c-7eb50dc448f9 2147483648 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2069218-14aa-4042-bd29-3f1b37802bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd5d410e-3e40-4fd9-8739-503cfc7aab65', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:57 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd59cb21-e450-45ab-853c-7eb50dc448f9 2147483648 Jul 07 22:03:57 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb2cd4a-0e18-4c99-92a4-25010eb0748e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:57 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Volume volume-fd5d410e-3e40-4fd9-8739-503cfc7aab65 (fd5d410e-3e40-4fd9-8739-503cfc7aab65): created successfully Jul 07 22:03:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb2cd4a-0e18-4c99-92a4-25010eb0748e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Flow 'volume_create_manager' (72c0eccd-f3c6-4234-86ea-0ee1c5500b2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:03:57 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-db514847-ed50-44c3-a062-345b25286c19 tempest-VolumesActionsTest-56686579 None] Created volume successfully. Jul 07 22:03:57 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-72ceb87f-e33a-4935-8cdf-8f77681eff2e tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fa57060f-441f-4216-9e65-b2e67f0afd6b" returned: 0 in 0.871s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-72ceb87f-e33a-4935-8cdf-8f77681eff2e tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fa57060f-441f-4216-9e65-b2e67f0afd6b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:57 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fa57060f-441f-4216-9e65-b2e67f0afd6b Jul 07 22:03:57 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:58 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d3065f48-13a1-4bef-bfd6-26aa114a413e tempest-VolumesActionsTest-56686579 None] Acquiring lock "cinder-fd5d410e-3e40-4fd9-8739-503cfc7aab65" by "attach_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:58 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d3065f48-13a1-4bef-bfd6-26aa114a413e tempest-VolumesActionsTest-56686579 None] Lock "cinder-fd5d410e-3e40-4fd9-8739-503cfc7aab65" acquired by "attach_volume" :: waited 0.031s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:58 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d3065f48-13a1-4bef-bfd6-26aa114a413e tempest-VolumesActionsTest-56686579 None] Attaching volume fd5d410e-3e40-4fd9-8739-503cfc7aab65 to instance da2461d8-14b4-4b7f-9716-cc6146076f8e at mountpoint /dev/vdb on host None. Jul 07 22:03:58 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d3065f48-13a1-4bef-bfd6-26aa114a413e tempest-VolumesActionsTest-56686579 None] Attach volume completed successfully. Jul 07 22:03:58 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd59cb21-e450-45ab-853c-7eb50dc448f9 2147483648" returned: 0 in 1.108s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:58 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d3065f48-13a1-4bef-bfd6-26aa114a413e tempest-VolumesActionsTest-56686579 None] Lock "cinder-fd5d410e-3e40-4fd9-8739-503cfc7aab65" released by "attach_volume" :: held 0.121s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:58 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-72ceb87f-e33a-4935-8cdf-8f77681eff2e tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fa57060f-441f-4216-9e65-b2e67f0afd6b" returned: 0 in 0.745s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:58 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-72ceb87f-e33a-4935-8cdf-8f77681eff2e tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-fa57060f-441f-4216-9e65-b2e67f0afd6b" released by "delete_volume" :: held 1.664s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd59cb21-e450-45ab-853c-7eb50dc448f9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:58 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd59cb21-e450-45ab-853c-7eb50dc448f9 Jul 07 22:03:58 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:58 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-72ceb87f-e33a-4935-8cdf-8f77681eff2e tempest-VolumesSnapshotTestJSON-1830172248 None] Created reservations ['a525735e-ce0e-43ff-8ed0-6f74f97bd9eb', 'fa4602ae-2ea4-4bf9-a13c-a2e930ab841f', 'd2e63b22-2b8c-498b-9341-13fbd07b5ab5', '34965c2f-254a-4986-a61c-22bd39d73f4d'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:03:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-72ceb87f-e33a-4935-8cdf-8f77681eff2e tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:03:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-72ceb87f-e33a-4935-8cdf-8f77681eff2e tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:03:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-72ceb87f-e33a-4935-8cdf-8f77681eff2e tempest-VolumesSnapshotTestJSON-1830172248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:03:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-72ceb87f-e33a-4935-8cdf-8f77681eff2e tempest-VolumesSnapshotTestJSON-1830172248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:03:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-72ceb87f-e33a-4935-8cdf-8f77681eff2e tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-72ceb87f-e33a-4935-8cdf-8f77681eff2e tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:58 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:03:58 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:59 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd59cb21-e450-45ab-853c-7eb50dc448f9" returned: 0 in 0.768s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fb8a2fd1-6789-45d4-b8fe-3d0d3215f6d5 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-c1000cf5-d186-4577-8b92-d6c614eab9cd-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:03:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:03:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fb8a2fd1-6789-45d4-b8fe-3d0d3215f6d5 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-c1000cf5-d186-4577-8b92-d6c614eab9cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fb8a2fd1-6789-45d4-b8fe-3d0d3215f6d5 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-quobyte-0a723777-599f-425a-ba87-fc900f320fa9" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b438dd-e6d4-4580-a613-a323ae13f7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd59cb21-e450-45ab-853c-7eb50dc448f9', 'volume_size': 2}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (affcc061-2d98-41cb-a2b0-9411214e12d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:03:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fb8a2fd1-6789-45d4-b8fe-3d0d3215f6d5 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-0a723777-599f-425a-ba87-fc900f320fa9" acquired by "delete_snapshot" :: waited 0.104s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fb8a2fd1-6789-45d4-b8fe-3d0d3215f6d5 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-quobyte-c1000cf5-d186-4577-8b92-d6c614eab9cd" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:03:59 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Volume volume-dd59cb21-e450-45ab-853c-7eb50dc448f9 (dd59cb21-e450-45ab-853c-7eb50dc448f9): created successfully Jul 07 22:03:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (affcc061-2d98-41cb-a2b0-9411214e12d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:03:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Flow 'volume_create_manager' (b5cedd4c-fedc-4aba-99f5-240596c71e2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:03:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fb8a2fd1-6789-45d4-b8fe-3d0d3215f6d5 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-c1000cf5-d186-4577-8b92-d6c614eab9cd" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:03:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-fb8a2fd1-6789-45d4-b8fe-3d0d3215f6d5 tempest-VolumesSnapshotTestJSON-1830172248 None] Deleting offline snapshot c1000cf5-d186-4577-8b92-d6c614eab9cd of volume 0a723777-599f-425a-ba87-fc900f320fa9 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:03:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-fb8a2fd1-6789-45d4-b8fe-3d0d3215f6d5 tempest-VolumesSnapshotTestJSON-1830172248 None] snapshot_file for this snap is: volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:03:59 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6d7942-cfb9-46eb-989d-462b00fd5bbf]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:03:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fb8a2fd1-6789-45d4-b8fe-3d0d3215f6d5 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:03:59 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-15990db9-1d77-4292-bdc7-3aade6c31bcb tempest-VolumesCloneNegativeTest-781522433 None] Created volume successfully. Jul 07 22:03:59 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd Jul 07 22:03:59 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:03:59 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Jul 07 22:03:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-72ceb87f-e33a-4935-8cdf-8f77681eff2e tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.192s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:03:59 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-72ceb87f-e33a-4935-8cdf-8f77681eff2e tempest-VolumesSnapshotTestJSON-1830172248 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:03:59 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-72ceb87f-e33a-4935-8cdf-8f77681eff2e tempest-VolumesSnapshotTestJSON-1830172248 None] Deleted volume successfully. Jul 07 22:03:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-72ceb87f-e33a-4935-8cdf-8f77681eff2e tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-fa57060f-441f-4216-9e65-b2e67f0afd6b-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:03:59 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-97d94b58-f9e3-4529-b454-68f46b18d8a0 tempest-VolumesActionsTest-1449825624 None] Terminate volume connection completed successfully. Jul 07 22:04:00 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9abd7646-e54a-4092-bce6-f869a7969492 tempest-VolumesCloneNegativeTest-781522433 None] Acquiring lock "cinder-dd59cb21-e450-45ab-853c-7eb50dc448f9-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:00 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9abd7646-e54a-4092-bce6-f869a7969492 tempest-VolumesCloneNegativeTest-781522433 None] Lock "cinder-dd59cb21-e450-45ab-853c-7eb50dc448f9-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:00 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:00 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9abd7646-e54a-4092-bce6-f869a7969492 tempest-VolumesCloneNegativeTest-781522433 None] Acquiring lock "cinder-quobyte-dd59cb21-e450-45ab-853c-7eb50dc448f9" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fb8a2fd1-6789-45d4-b8fe-3d0d3215f6d5 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd" returned: 0 in 0.978s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-fb8a2fd1-6789-45d4-b8fe-3d0d3215f6d5 tempest-VolumesSnapshotTestJSON-1830172248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a723777-599f-425a-ba87-fc900f320fa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:04:00 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9abd7646-e54a-4092-bce6-f869a7969492 tempest-VolumesCloneNegativeTest-781522433 None] Lock "cinder-quobyte-dd59cb21-e450-45ab-853c-7eb50dc448f9" acquired by "delete_volume" :: waited 0.099s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:00 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[41878550-7c1b-4d1c-b4a6-04838c9cde82]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:04:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fb8a2fd1-6789-45d4-b8fe-3d0d3215f6d5 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:00 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-97d94b58-f9e3-4529-b454-68f46b18d8a0 tempest-VolumesActionsTest-1449825624 None] Acquiring lock "cinder-fd5d410e-3e40-4fd9-8739-503cfc7aab65-detach_volume" by "detach_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:00 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f65a19-4c53-4f29-beae-e11c375b1639]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:04:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9abd7646-e54a-4092-bce6-f869a7969492 tempest-VolumesCloneNegativeTest-781522433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd59cb21-e450-45ab-853c-7eb50dc448f9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:00 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-97d94b58-f9e3-4529-b454-68f46b18d8a0 tempest-VolumesActionsTest-1449825624 None] Lock "cinder-fd5d410e-3e40-4fd9-8739-503cfc7aab65-detach_volume" acquired by "detach_volume" :: waited 0.048s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:00 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-97d94b58-f9e3-4529-b454-68f46b18d8a0 tempest-VolumesActionsTest-1449825624 None] Detaching volume fd5d410e-3e40-4fd9-8739-503cfc7aab65 from instance da2461d8-14b4-4b7f-9716-cc6146076f8e. Jul 07 22:04:00 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-97d94b58-f9e3-4529-b454-68f46b18d8a0 tempest-VolumesActionsTest-1449825624 None] Detach volume completed successfully. Jul 07 22:04:00 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9 Jul 07 22:04:00 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:00 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-97d94b58-f9e3-4529-b454-68f46b18d8a0 tempest-VolumesActionsTest-1449825624 None] Lock "cinder-fd5d410e-3e40-4fd9-8739-503cfc7aab65-detach_volume" released by "detach_volume" :: held 0.092s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:00 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd59cb21-e450-45ab-853c-7eb50dc448f9 Jul 07 22:04:00 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:01 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7a20785e-76c7-4558-b52d-9325e8035ba7 tempest-VolumesActionsTest-56686579 None] Acquiring lock "cinder-fd5d410e-3e40-4fd9-8739-503cfc7aab65-detach_volume" by "detach_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:01 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7a20785e-76c7-4558-b52d-9325e8035ba7 tempest-VolumesActionsTest-56686579 None] Lock "cinder-fd5d410e-3e40-4fd9-8739-503cfc7aab65-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:01 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-7a20785e-76c7-4558-b52d-9325e8035ba7 tempest-VolumesActionsTest-56686579 None] Volume detach called, but volume not attached. Jul 07 22:04:01 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7a20785e-76c7-4558-b52d-9325e8035ba7 tempest-VolumesActionsTest-56686579 None] Lock "cinder-fd5d410e-3e40-4fd9-8739-503cfc7aab65-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:01 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9abd7646-e54a-4092-bce6-f869a7969492 tempest-VolumesCloneNegativeTest-781522433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd59cb21-e450-45ab-853c-7eb50dc448f9" returned: 0 in 0.867s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9abd7646-e54a-4092-bce6-f869a7969492 tempest-VolumesCloneNegativeTest-781522433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd59cb21-e450-45ab-853c-7eb50dc448f9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:01 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd59cb21-e450-45ab-853c-7eb50dc448f9 Jul 07 22:04:01 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:01 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fb8a2fd1-6789-45d4-b8fe-3d0d3215f6d5 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9" returned: 0 in 1.149s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fb8a2fd1-6789-45d4-b8fe-3d0d3215f6d5 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:01 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd Jul 07 22:04:01 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8880ac1b-8ec3-49b3-8955-a9ced41eb8a2 tempest-VolumesActionsTest-56686579 None] Acquiring lock "cinder-fd5d410e-3e40-4fd9-8739-503cfc7aab65-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8880ac1b-8ec3-49b3-8955-a9ced41eb8a2 tempest-VolumesActionsTest-56686579 None] Lock "cinder-fd5d410e-3e40-4fd9-8739-503cfc7aab65-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8880ac1b-8ec3-49b3-8955-a9ced41eb8a2 tempest-VolumesActionsTest-56686579 None] Acquiring lock "cinder-quobyte-fd5d410e-3e40-4fd9-8739-503cfc7aab65" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8880ac1b-8ec3-49b3-8955-a9ced41eb8a2 tempest-VolumesActionsTest-56686579 None] Lock "cinder-quobyte-fd5d410e-3e40-4fd9-8739-503cfc7aab65" acquired by "delete_volume" :: waited 0.031s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:02 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[49375ead-f953-4d55-a357-fe1576318ebd]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:04:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8880ac1b-8ec3-49b3-8955-a9ced41eb8a2 tempest-VolumesActionsTest-56686579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd5d410e-3e40-4fd9-8739-503cfc7aab65 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:02 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9abd7646-e54a-4092-bce6-f869a7969492 tempest-VolumesCloneNegativeTest-781522433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd59cb21-e450-45ab-853c-7eb50dc448f9" returned: 0 in 1.083s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:02 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd5d410e-3e40-4fd9-8739-503cfc7aab65 Jul 07 22:04:02 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9abd7646-e54a-4092-bce6-f869a7969492 tempest-VolumesCloneNegativeTest-781522433 None] Lock "cinder-quobyte-dd59cb21-e450-45ab-853c-7eb50dc448f9" released by "delete_volume" :: held 2.054s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:02 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-9abd7646-e54a-4092-bce6-f869a7969492 tempest-VolumesCloneNegativeTest-781522433 None] Created reservations ['8bba5571-edad-45b6-94b5-34384344b9ae', '2dd7b865-c55e-4e4c-b794-5bbd591e200e', '1d8b05a4-af88-49a6-a584-08d9bb90ea12', 'b89349d9-4e3e-45e1-abb7-ecd2b83c4cce'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:04:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9abd7646-e54a-4092-bce6-f869a7969492 tempest-VolumesCloneNegativeTest-781522433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9abd7646-e54a-4092-bce6-f869a7969492 tempest-VolumesCloneNegativeTest-781522433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9abd7646-e54a-4092-bce6-f869a7969492 tempest-VolumesCloneNegativeTest-781522433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9abd7646-e54a-4092-bce6-f869a7969492 tempest-VolumesCloneNegativeTest-781522433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9abd7646-e54a-4092-bce6-f869a7969492 tempest-VolumesCloneNegativeTest-781522433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9abd7646-e54a-4092-bce6-f869a7969492 tempest-VolumesCloneNegativeTest-781522433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:02 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:04:02 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:03 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fb8a2fd1-6789-45d4-b8fe-3d0d3215f6d5 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd" returned: 0 in 1.456s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fb8a2fd1-6789-45d4-b8fe-3d0d3215f6d5 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:03 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd Jul 07 22:04:03 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:03 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8880ac1b-8ec3-49b3-8955-a9ced41eb8a2 tempest-VolumesActionsTest-56686579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd5d410e-3e40-4fd9-8739-503cfc7aab65" returned: 0 in 1.190s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8880ac1b-8ec3-49b3-8955-a9ced41eb8a2 tempest-VolumesActionsTest-56686579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd5d410e-3e40-4fd9-8739-503cfc7aab65 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:03 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd5d410e-3e40-4fd9-8739-503cfc7aab65 Jul 07 22:04:03 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:04 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9abd7646-e54a-4092-bce6-f869a7969492 tempest-VolumesCloneNegativeTest-781522433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.217s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:04 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-9abd7646-e54a-4092-bce6-f869a7969492 tempest-VolumesCloneNegativeTest-781522433 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:04:04 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-9abd7646-e54a-4092-bce6-f869a7969492 tempest-VolumesCloneNegativeTest-781522433 None] Deleted volume successfully. Jul 07 22:04:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9abd7646-e54a-4092-bce6-f869a7969492 tempest-VolumesCloneNegativeTest-781522433 None] Lock "cinder-dd59cb21-e450-45ab-853c-7eb50dc448f9-delete_volume" released by "delete_volume" :: held 3.814s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:04 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fb8a2fd1-6789-45d4-b8fe-3d0d3215f6d5 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9.c1000cf5-d186-4577-8b92-d6c614eab9cd" returned: 0 in 1.658s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fb8a2fd1-6789-45d4-b8fe-3d0d3215f6d5 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-c1000cf5-d186-4577-8b92-d6c614eab9cd" released by "_delete_snapshot" :: held 5.497s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fb8a2fd1-6789-45d4-b8fe-3d0d3215f6d5 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-0a723777-599f-425a-ba87-fc900f320fa9" released by "delete_snapshot" :: held 5.571s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:04 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-fb8a2fd1-6789-45d4-b8fe-3d0d3215f6d5 tempest-VolumesSnapshotTestJSON-1830172248 None] Created reservations ['06cd31d2-7e8a-4d27-8c71-3385d036522a', 'c5e3adcb-bcd6-454d-b9b7-2984e1913f3e', '8edfd2b0-f53b-4a29-b045-90b4025e5c19', 'd121c325-76fa-4652-95d8-0bc38b632d52'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:04:05 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-fb8a2fd1-6789-45d4-b8fe-3d0d3215f6d5 tempest-VolumesSnapshotTestJSON-1830172248 None] Delete snapshot completed successfully. Jul 07 22:04:05 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fb8a2fd1-6789-45d4-b8fe-3d0d3215f6d5 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-c1000cf5-d186-4577-8b92-d6c614eab9cd-delete_snapshot" released by "delete_snapshot" :: held 5.914s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:05 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8880ac1b-8ec3-49b3-8955-a9ced41eb8a2 tempest-VolumesActionsTest-56686579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd5d410e-3e40-4fd9-8739-503cfc7aab65" returned: 0 in 1.542s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:05 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8880ac1b-8ec3-49b3-8955-a9ced41eb8a2 tempest-VolumesActionsTest-56686579 None] Lock "cinder-quobyte-fd5d410e-3e40-4fd9-8739-503cfc7aab65" released by "delete_volume" :: held 2.802s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:05 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-8880ac1b-8ec3-49b3-8955-a9ced41eb8a2 tempest-VolumesActionsTest-56686579 None] Created reservations ['5e7af97a-f8c9-4e9d-a9b2-8421172aa909', 'b42d520c-caee-4dfb-87d3-e5c750bafa68', '3564512c-eb8d-44e4-ab70-c427909d39a1', '724a703c-2401-407e-a0b0-c00f1ebc2ca4'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:04:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8880ac1b-8ec3-49b3-8955-a9ced41eb8a2 tempest-VolumesActionsTest-56686579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8880ac1b-8ec3-49b3-8955-a9ced41eb8a2 tempest-VolumesActionsTest-56686579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:05 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8880ac1b-8ec3-49b3-8955-a9ced41eb8a2 tempest-VolumesActionsTest-56686579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:05 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8880ac1b-8ec3-49b3-8955-a9ced41eb8a2 tempest-VolumesActionsTest-56686579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8880ac1b-8ec3-49b3-8955-a9ced41eb8a2 tempest-VolumesActionsTest-56686579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8880ac1b-8ec3-49b3-8955-a9ced41eb8a2 tempest-VolumesActionsTest-56686579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:05 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:04:05 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:05 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-80798d94-5f56-4431-8530-b15a7beb3352 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-0a723777-599f-425a-ba87-fc900f320fa9-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:05 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-80798d94-5f56-4431-8530-b15a7beb3352 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-0a723777-599f-425a-ba87-fc900f320fa9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:06 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-80798d94-5f56-4431-8530-b15a7beb3352 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-quobyte-0a723777-599f-425a-ba87-fc900f320fa9" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:06 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-80798d94-5f56-4431-8530-b15a7beb3352 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-0a723777-599f-425a-ba87-fc900f320fa9" acquired by "delete_volume" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:06 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f088b53-a6cf-40f0-b06d-2078b64859a5]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:04:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-80798d94-5f56-4431-8530-b15a7beb3352 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:06 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8880ac1b-8ec3-49b3-8955-a9ced41eb8a2 tempest-VolumesActionsTest-56686579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.924s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:06 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-8880ac1b-8ec3-49b3-8955-a9ced41eb8a2 tempest-VolumesActionsTest-56686579 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:04:06 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-8880ac1b-8ec3-49b3-8955-a9ced41eb8a2 tempest-VolumesActionsTest-56686579 None] Deleted volume successfully. Jul 07 22:04:06 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8880ac1b-8ec3-49b3-8955-a9ced41eb8a2 tempest-VolumesActionsTest-56686579 None] Lock "cinder-fd5d410e-3e40-4fd9-8739-503cfc7aab65-delete_volume" released by "delete_volume" :: held 4.061s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:06 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9 Jul 07 22:04:06 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:07 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-80798d94-5f56-4431-8530-b15a7beb3352 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9" returned: 0 in 1.148s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-80798d94-5f56-4431-8530-b15a7beb3352 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:07 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9 Jul 07 22:04:07 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:08 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-80798d94-5f56-4431-8530-b15a7beb3352 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a723777-599f-425a-ba87-fc900f320fa9" returned: 0 in 0.900s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-80798d94-5f56-4431-8530-b15a7beb3352 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-0a723777-599f-425a-ba87-fc900f320fa9" released by "delete_volume" :: held 2.164s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-80798d94-5f56-4431-8530-b15a7beb3352 tempest-VolumesSnapshotTestJSON-1830172248 None] Created reservations ['04409fde-2490-40a7-983e-9865c6eac814', '3b4bd3bf-f04f-458f-910b-9bcb0e8e1cbf', 'f9bf2931-aeb3-4f08-9f93-e180ef96dab1', '61fb055d-8384-49cc-9383-ececf523547b'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-80798d94-5f56-4431-8530-b15a7beb3352 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-80798d94-5f56-4431-8530-b15a7beb3352 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-80798d94-5f56-4431-8530-b15a7beb3352 tempest-VolumesSnapshotTestJSON-1830172248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-80798d94-5f56-4431-8530-b15a7beb3352 tempest-VolumesSnapshotTestJSON-1830172248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-80798d94-5f56-4431-8530-b15a7beb3352 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-80798d94-5f56-4431-8530-b15a7beb3352 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:08 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:04:08 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Flow 'volume_create_manager' (e722ebf5-d7b1-4f21-82a2-fb221f452575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12fee6e-3052-4f48-9052-56f2d66c0f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12fee6e-3052-4f48-9052-56f2d66c0f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-218685027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9e7674a-3bcb-4844-b497-650bd8535e3e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9d4aea704e354c598490def644cd75a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:04:08Z,use_quota=True,user_id='e7187d0881e84c4c8babd32a20babd53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908dfd93-a17c-409b-a681-f3f762cc639a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (908dfd93-a17c-409b-a681-f3f762cc639a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c8cebdd-b4f8-4a9d-9b35-7e46512087cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c8cebdd-b4f8-4a9d-9b35-7e46512087cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9e7674a-3bcb-4844-b497-650bd8535e3e', 'volume_name': 'volume-c9e7674a-3bcb-4844-b497-650bd8535e3e', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a597d39-fee6-4d41-9292-b5e0bace83b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a597d39-fee6-4d41-9292-b5e0bace83b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b4855d-c0b6-47a1-a476-95c66413972c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:08 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Volume c9e7674a-3bcb-4844-b497-650bd8535e3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9e7674a-3bcb-4844-b497-650bd8535e3e', 'volume_size': 1} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-218685027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9e7674a-3bcb-4844-b497-650bd8535e3e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9d4aea704e354c598490def644cd75a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:04:08Z,use_quota=True,user_id='e7187d0881e84c4c8babd32a20babd53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Creating volume c9e7674a-3bcb-4844-b497-650bd8535e3e {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:04:08 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9e7674a-3bcb-4844-b497-650bd8535e3e 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:08 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9e7674a-3bcb-4844-b497-650bd8535e3e 1073741824 Jul 07 22:04:08 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Flow 'volume_create_manager' (95892e8d-54be-425c-af3f-a862d6500fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dcf9305-7be0-4fe4-8e48-0101033a0fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dcf9305-7be0-4fe4-8e48-0101033a0fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-725272738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4758e8c2-8235-46e1-8bea-2730b056e6b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f4a4c48651e4ea492eca1d627c2289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:04:09Z,use_quota=True,user_id='d17d7aee0b6246399e91ea8b0f10c766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e8b85e2-bf37-4b0e-9ffe-225ccd950191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e8b85e2-bf37-4b0e-9ffe-225ccd950191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8154336-c8bd-43ad-b881-fb057c8414e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8154336-c8bd-43ad-b881-fb057c8414e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4758e8c2-8235-46e1-8bea-2730b056e6b1', 'volume_name': 'volume-4758e8c2-8235-46e1-8bea-2730b056e6b1', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8910b196-e612-4467-8b7c-aea8bc8a9f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8910b196-e612-4467-8b7c-aea8bc8a9f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65edf62b-9996-4f9b-8734-47ac95411898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:09 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Volume 4758e8c2-8235-46e1-8bea-2730b056e6b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4758e8c2-8235-46e1-8bea-2730b056e6b1', 'volume_size': 1} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:04:09 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Flow 'volume_create_manager' (72b0e04b-7bdd-456f-811d-5aae3b88bda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a60e67-409d-485a-9994-0e9cf77618ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-80798d94-5f56-4431-8530-b15a7beb3352 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.060s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-80798d94-5f56-4431-8530-b15a7beb3352 tempest-VolumesSnapshotTestJSON-1830172248 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a60e67-409d-485a-9994-0e9cf77618ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-929635500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b7bc4b-6335-4650-a7fa-46edac0b6155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f4a4c48651e4ea492eca1d627c2289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:04:09Z,use_quota=True,user_id='d17d7aee0b6246399e91ea8b0f10c766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1b5d48-c06a-42f9-97f0-40dfb2e11404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1b5d48-c06a-42f9-97f0-40dfb2e11404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1a09da-e746-42ef-848b-4d840258985f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1a09da-e746-42ef-848b-4d840258985f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32b7bc4b-6335-4650-a7fa-46edac0b6155', 'volume_name': 'volume-32b7bc4b-6335-4650-a7fa-46edac0b6155', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5563f728-0ec8-40dc-9d0d-ee5529cca129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5563f728-0ec8-40dc-9d0d-ee5529cca129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950f8f60-64be-43fc-8461-86722d4f43f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:09 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Volume 32b7bc4b-6335-4650-a7fa-46edac0b6155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32b7bc4b-6335-4650-a7fa-46edac0b6155', 'volume_size': 1} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:09 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-80798d94-5f56-4431-8530-b15a7beb3352 tempest-VolumesSnapshotTestJSON-1830172248 None] Deleted volume successfully. Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-80798d94-5f56-4431-8530-b15a7beb3352 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-0a723777-599f-425a-ba87-fc900f320fa9-delete_volume" released by "delete_volume" :: held 3.682s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4af8105e-791c-4e65-9d8a-8b4448115754 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-905036a9-e532-48bc-b5e7-02f6acda00f0-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4af8105e-791c-4e65-9d8a-8b4448115754 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-905036a9-e532-48bc-b5e7-02f6acda00f0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4af8105e-791c-4e65-9d8a-8b4448115754 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "cinder-quobyte-905036a9-e532-48bc-b5e7-02f6acda00f0" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4af8105e-791c-4e65-9d8a-8b4448115754 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-905036a9-e532-48bc-b5e7-02f6acda00f0" acquired by "delete_volume" :: waited 0.031s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[66129de8-b5fd-4bd6-9b8e-f91456f6db4d]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:04:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4af8105e-791c-4e65-9d8a-8b4448115754 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:09 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0 Jul 07 22:04:09 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:10 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9e7674a-3bcb-4844-b497-650bd8535e3e 1073741824" returned: 0 in 1.382s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9e7674a-3bcb-4844-b497-650bd8535e3e {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:10 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9e7674a-3bcb-4844-b497-650bd8535e3e Jul 07 22:04:10 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:10 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4af8105e-791c-4e65-9d8a-8b4448115754 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0" returned: 0 in 0.863s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4af8105e-791c-4e65-9d8a-8b4448115754 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:10 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0 Jul 07 22:04:10 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:11 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9e7674a-3bcb-4844-b497-650bd8535e3e" returned: 0 in 0.854s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] <== create_volume: return (2299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.302s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.994s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-725272738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4758e8c2-8235-46e1-8bea-2730b056e6b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f4a4c48651e4ea492eca1d627c2289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:04:09Z,use_quota=True,user_id='d17d7aee0b6246399e91ea8b0f10c766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Creating volume 4758e8c2-8235-46e1-8bea-2730b056e6b1 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:04:11 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4758e8c2-8235-46e1-8bea-2730b056e6b1 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:11 devstack sudo[98393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4758e8c2-8235-46e1-8bea-2730b056e6b1 1073741824 Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b4855d-c0b6-47a1-a476-95c66413972c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9e7674a-3bcb-4844-b497-650bd8535e3e', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:11 devstack sudo[98393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db6dfb5-fd1f-4da6-8781-cedba7dce5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:11 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Volume volume-c9e7674a-3bcb-4844-b497-650bd8535e3e (c9e7674a-3bcb-4844-b497-650bd8535e3e): created successfully Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db6dfb5-fd1f-4da6-8781-cedba7dce5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Flow 'volume_create_manager' (e722ebf5-d7b1-4f21-82a2-fb221f452575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:04:11 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-e8163c8e-99c5-44e2-8113-fbb36dd326e7 tempest-VolumesGetTest-1443487843 None] Created volume successfully. Jul 07 22:04:11 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4af8105e-791c-4e65-9d8a-8b4448115754 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-905036a9-e532-48bc-b5e7-02f6acda00f0" returned: 0 in 0.794s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4af8105e-791c-4e65-9d8a-8b4448115754 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-quobyte-905036a9-e532-48bc-b5e7-02f6acda00f0" released by "delete_volume" :: held 1.749s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-4af8105e-791c-4e65-9d8a-8b4448115754 tempest-VolumesSnapshotTestJSON-1830172248 None] Created reservations ['0fcccd52-7dc0-403b-b582-cb46e13ca375', '8f838ced-407e-4296-a17b-5ac3acd56544', '5783d019-995b-44a4-bd7a-801b19d2a3e9', '3880a68f-b02b-4aeb-8665-918ea685d569'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4af8105e-791c-4e65-9d8a-8b4448115754 tempest-VolumesSnapshotTestJSON-1830172248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4af8105e-791c-4e65-9d8a-8b4448115754 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4af8105e-791c-4e65-9d8a-8b4448115754 tempest-VolumesSnapshotTestJSON-1830172248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4af8105e-791c-4e65-9d8a-8b4448115754 tempest-VolumesSnapshotTestJSON-1830172248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4af8105e-791c-4e65-9d8a-8b4448115754 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4af8105e-791c-4e65-9d8a-8b4448115754 tempest-VolumesSnapshotTestJSON-1830172248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:11 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:04:11 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:12 devstack sudo[98393]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4758e8c2-8235-46e1-8bea-2730b056e6b1 1073741824" returned: 0 in 1.240s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4758e8c2-8235-46e1-8bea-2730b056e6b1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:12 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4758e8c2-8235-46e1-8bea-2730b056e6b1 Jul 07 22:04:12 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:12 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:04:12 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Flow 'volume_create_manager' (4d67330c-6dfc-4926-b0e1-6242c6841bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:04:12 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d16fdd-c29c-46da-8118-7cbce47aa5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:12 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d16fdd-c29c-46da-8118-7cbce47aa5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:04:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-661678194',display_name='tempest-VolumesGetTest-Volume-24170501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ad6beb-0c0b-4a2d-832e-4454a00e5f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4aea704e354c598490def644cd75a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:04:13Z,use_quota=True,user_id='e7187d0881e84c4c8babd32a20babd53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:12 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3db57a4-07cc-4e3b-a095-bfa5662981d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:12 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3db57a4-07cc-4e3b-a095-bfa5662981d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:12 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9b815c-6627-473b-b8e1-21452c87d9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:12 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9b815c-6627-473b-b8e1-21452c87d9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69ad6beb-0c0b-4a2d-832e-4454a00e5f61', 'volume_name': 'volume-69ad6beb-0c0b-4a2d-832e-4454a00e5f61', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:12 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b418e9-b6d7-44e7-bf21-810affc007ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:12 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b418e9-b6d7-44e7-bf21-810affc007ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:12 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd25532b-bd72-4182-835c-60800ad63571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:12 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Volume 69ad6beb-0c0b-4a2d-832e-4454a00e5f61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69ad6beb-0c0b-4a2d-832e-4454a00e5f61', 'volume_size': 1} Jul 07 22:04:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:12 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4af8105e-791c-4e65-9d8a-8b4448115754 tempest-VolumesSnapshotTestJSON-1830172248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.186s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:12 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-4af8105e-791c-4e65-9d8a-8b4448115754 tempest-VolumesSnapshotTestJSON-1830172248 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:04:12 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-4af8105e-791c-4e65-9d8a-8b4448115754 tempest-VolumesSnapshotTestJSON-1830172248 None] Deleted volume successfully. Jul 07 22:04:12 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4af8105e-791c-4e65-9d8a-8b4448115754 tempest-VolumesSnapshotTestJSON-1830172248 None] Lock "cinder-905036a9-e532-48bc-b5e7-02f6acda00f0-delete_volume" released by "delete_volume" :: held 3.244s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:13 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4758e8c2-8235-46e1-8bea-2730b056e6b1" returned: 0 in 0.957s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] <== create_volume: return (2283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:04:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.289s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.730s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-929635500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b7bc4b-6335-4650-a7fa-46edac0b6155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f4a4c48651e4ea492eca1d627c2289c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:04:09Z,use_quota=True,user_id='d17d7aee0b6246399e91ea8b0f10c766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:04:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Creating volume 32b7bc4b-6335-4650-a7fa-46edac0b6155 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:04:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:04:13 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:04:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-32b7bc4b-6335-4650-a7fa-46edac0b6155 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65edf62b-9996-4f9b-8734-47ac95411898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4758e8c2-8235-46e1-8bea-2730b056e6b1', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:13 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-32b7bc4b-6335-4650-a7fa-46edac0b6155 1073741824 Jul 07 22:04:13 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0033f9-8d46-48f8-89bf-10e393991969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:13 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Volume volume-4758e8c2-8235-46e1-8bea-2730b056e6b1 (4758e8c2-8235-46e1-8bea-2730b056e6b1): created successfully Jul 07 22:04:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0033f9-8d46-48f8-89bf-10e393991969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Flow 'volume_create_manager' (95892e8d-54be-425c-af3f-a862d6500fa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:04:13 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-4ac52b4f-1c61-46a3-884c-f5fbc05b9d9e tempest-TestServerVolumeAttachmentScenario-1005538216 None] Created volume successfully. Jul 07 22:04:14 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-32b7bc4b-6335-4650-a7fa-46edac0b6155 1073741824" returned: 0 in 1.121s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-32b7bc4b-6335-4650-a7fa-46edac0b6155 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:14 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-32b7bc4b-6335-4650-a7fa-46edac0b6155 Jul 07 22:04:14 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:14 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:04:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Flow 'volume_create_manager' (ab650aab-e645-4686-b5e7-f8905a5f020b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:04:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6887dd57-7a5b-46ae-adab-a93855f62cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6887dd57-7a5b-46ae-adab-a93855f62cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-931802544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1388e9-bed0-4ff2-88ca-e230f973d2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84800c3ec4a49079e964460ba092274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:04:15Z,use_quota=True,user_id='a58819f043f14c9790b7acfd4d627c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d51be3-009c-48d2-9d29-34de3cc2ee78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d51be3-009c-48d2-9d29-34de3cc2ee78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b550ce93-f48d-4e60-aca1-b356ecf1f3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b550ce93-f48d-4e60-aca1-b356ecf1f3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f1388e9-bed0-4ff2-88ca-e230f973d2c1', 'volume_name': 'volume-9f1388e9-bed0-4ff2-88ca-e230f973d2c1', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90648494-86ff-4c08-9e08-ade028965234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90648494-86ff-4c08-9e08-ade028965234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0264830f-d8f2-43d2-9082-cbb925a2f28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:14 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Volume 9f1388e9-bed0-4ff2-88ca-e230f973d2c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f1388e9-bed0-4ff2-88ca-e230f973d2c1', 'volume_size': 1} Jul 07 22:04:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:15 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-32b7bc4b-6335-4650-a7fa-46edac0b6155" returned: 0 in 0.795s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] <== create_volume: return (1994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:04:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.999s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.544s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:04:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-661678194',display_name='tempest-VolumesGetTest-Volume-24170501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ad6beb-0c0b-4a2d-832e-4454a00e5f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4aea704e354c598490def644cd75a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:04:13Z,use_quota=True,user_id='e7187d0881e84c4c8babd32a20babd53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:04:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Creating volume 69ad6beb-0c0b-4a2d-832e-4454a00e5f61 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:04:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:04:15 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:04:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-69ad6beb-0c0b-4a2d-832e-4454a00e5f61 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950f8f60-64be-43fc-8461-86722d4f43f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32b7bc4b-6335-4650-a7fa-46edac0b6155', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:15 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-69ad6beb-0c0b-4a2d-832e-4454a00e5f61 1073741824 Jul 07 22:04:15 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eae1206-439d-4210-b0ab-d58a0b23a1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:15 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Volume volume-32b7bc4b-6335-4650-a7fa-46edac0b6155 (32b7bc4b-6335-4650-a7fa-46edac0b6155): created successfully Jul 07 22:04:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eae1206-439d-4210-b0ab-d58a0b23a1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Flow 'volume_create_manager' (72b0e04b-7bdd-456f-811d-5aae3b88bda4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:04:15 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-3196eb53-54c2-4aa2-8a84-1c976d68a32d tempest-TestServerVolumeAttachmentScenario-1005538216 None] Created volume successfully. Jul 07 22:04:16 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-69ad6beb-0c0b-4a2d-832e-4454a00e5f61 1073741824" returned: 0 in 0.922s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-69ad6beb-0c0b-4a2d-832e-4454a00e5f61 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:16 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-69ad6beb-0c0b-4a2d-832e-4454a00e5f61 Jul 07 22:04:16 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:16 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-69ad6beb-0c0b-4a2d-832e-4454a00e5f61" returned: 0 in 0.688s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:04:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.035s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-931802544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1388e9-bed0-4ff2-88ca-e230f973d2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84800c3ec4a49079e964460ba092274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:04:15Z,use_quota=True,user_id='a58819f043f14c9790b7acfd4d627c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:04:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Creating volume 9f1388e9-bed0-4ff2-88ca-e230f973d2c1 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:04:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:04:16 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:04:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9f1388e9-bed0-4ff2-88ca-e230f973d2c1 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:17 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9f1388e9-bed0-4ff2-88ca-e230f973d2c1 1073741824 Jul 07 22:04:17 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd25532b-bd72-4182-835c-60800ad63571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69ad6beb-0c0b-4a2d-832e-4454a00e5f61', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a7f51e-1141-4bed-87e0-86fda1448dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:17 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Volume volume-69ad6beb-0c0b-4a2d-832e-4454a00e5f61 (69ad6beb-0c0b-4a2d-832e-4454a00e5f61): created successfully Jul 07 22:04:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a7f51e-1141-4bed-87e0-86fda1448dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Flow 'volume_create_manager' (4d67330c-6dfc-4926-b0e1-6242c6841bc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:04:17 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-24522db0-dfa6-4002-90bb-6779f1ecc908 tempest-VolumesGetTest-1443487843 None] Created volume successfully. Jul 07 22:04:17 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9f1388e9-bed0-4ff2-88ca-e230f973d2c1 1073741824" returned: 0 in 0.881s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9f1388e9-bed0-4ff2-88ca-e230f973d2c1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:17 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9f1388e9-bed0-4ff2-88ca-e230f973d2c1 Jul 07 22:04:17 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0e209eb2-bdbf-4f36-bddd-783987bddf29 tempest-VolumesGetTest-1443487843 None] Acquiring lock "cinder-69ad6beb-0c0b-4a2d-832e-4454a00e5f61-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0e209eb2-bdbf-4f36-bddd-783987bddf29 tempest-VolumesGetTest-1443487843 None] Lock "cinder-69ad6beb-0c0b-4a2d-832e-4454a00e5f61-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0e209eb2-bdbf-4f36-bddd-783987bddf29 tempest-VolumesGetTest-1443487843 None] Acquiring lock "cinder-quobyte-69ad6beb-0c0b-4a2d-832e-4454a00e5f61" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0e209eb2-bdbf-4f36-bddd-783987bddf29 tempest-VolumesGetTest-1443487843 None] Lock "cinder-quobyte-69ad6beb-0c0b-4a2d-832e-4454a00e5f61" acquired by "delete_volume" :: waited 0.022s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:18 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f935d98-89ca-482a-8ecd-10e69951f479]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:04:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0e209eb2-bdbf-4f36-bddd-783987bddf29 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-69ad6beb-0c0b-4a2d-832e-4454a00e5f61 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:18 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-69ad6beb-0c0b-4a2d-832e-4454a00e5f61 Jul 07 22:04:18 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:18 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9f1388e9-bed0-4ff2-88ca-e230f973d2c1" returned: 0 in 0.923s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:04:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0264830f-d8f2-43d2-9082-cbb925a2f28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f1388e9-bed0-4ff2-88ca-e230f973d2c1', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8e74c28-e512-42e0-8973-cff78b1eaf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:18 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Volume volume-9f1388e9-bed0-4ff2-88ca-e230f973d2c1 (9f1388e9-bed0-4ff2-88ca-e230f973d2c1): created successfully Jul 07 22:04:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8e74c28-e512-42e0-8973-cff78b1eaf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Flow 'volume_create_manager' (ab650aab-e645-4686-b5e7-f8905a5f020b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:04:18 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ab4714e1-953e-457c-b71e-3f3c850789fb tempest-VolumesActionsTest-56686579 None] Created volume successfully. Jul 07 22:04:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-44c06699-0735-4f9e-a467-066360818147 tempest-VolumesActionsTest-1449825624 None] Acquiring lock "cinder-9f1388e9-bed0-4ff2-88ca-e230f973d2c1-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-44c06699-0735-4f9e-a467-066360818147 tempest-VolumesActionsTest-1449825624 None] Lock "cinder-9f1388e9-bed0-4ff2-88ca-e230f973d2c1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-44c06699-0735-4f9e-a467-066360818147 tempest-VolumesActionsTest-1449825624 None] Acquiring lock "cinder-quobyte-9f1388e9-bed0-4ff2-88ca-e230f973d2c1" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:19 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0e209eb2-bdbf-4f36-bddd-783987bddf29 tempest-VolumesGetTest-1443487843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-69ad6beb-0c0b-4a2d-832e-4454a00e5f61" returned: 0 in 1.213s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0e209eb2-bdbf-4f36-bddd-783987bddf29 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-69ad6beb-0c0b-4a2d-832e-4454a00e5f61 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-44c06699-0735-4f9e-a467-066360818147 tempest-VolumesActionsTest-1449825624 None] Lock "cinder-quobyte-9f1388e9-bed0-4ff2-88ca-e230f973d2c1" acquired by "delete_volume" :: waited 0.042s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:19 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-69ad6beb-0c0b-4a2d-832e-4454a00e5f61 Jul 07 22:04:19 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:19 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4431767b-9613-4f4a-a3f0-476d8627b876]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:04:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-44c06699-0735-4f9e-a467-066360818147 tempest-VolumesActionsTest-1449825624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9f1388e9-bed0-4ff2-88ca-e230f973d2c1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:19 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9f1388e9-bed0-4ff2-88ca-e230f973d2c1 Jul 07 22:04:19 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:20 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0e209eb2-bdbf-4f36-bddd-783987bddf29 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-69ad6beb-0c0b-4a2d-832e-4454a00e5f61" returned: 0 in 1.249s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0e209eb2-bdbf-4f36-bddd-783987bddf29 tempest-VolumesGetTest-1443487843 None] Lock "cinder-quobyte-69ad6beb-0c0b-4a2d-832e-4454a00e5f61" released by "delete_volume" :: held 2.536s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:20 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-0e209eb2-bdbf-4f36-bddd-783987bddf29 tempest-VolumesGetTest-1443487843 None] Created reservations ['5c64dbcd-7f46-4b98-ae36-db74037d817b', '69be2b25-5bac-431d-8bb3-e734b55bb402', '8dfeeca0-90c3-44c7-9e8d-8c9d9eee0746', 'a6c9a68f-a0cd-4870-9cfc-e36a51ec5777'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:04:20 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-44c06699-0735-4f9e-a467-066360818147 tempest-VolumesActionsTest-1449825624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9f1388e9-bed0-4ff2-88ca-e230f973d2c1" returned: 0 in 1.366s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-44c06699-0735-4f9e-a467-066360818147 tempest-VolumesActionsTest-1449825624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9f1388e9-bed0-4ff2-88ca-e230f973d2c1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:21 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9f1388e9-bed0-4ff2-88ca-e230f973d2c1 Jul 07 22:04:21 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0e209eb2-bdbf-4f36-bddd-783987bddf29 tempest-VolumesGetTest-1443487843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0e209eb2-bdbf-4f36-bddd-783987bddf29 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0e209eb2-bdbf-4f36-bddd-783987bddf29 tempest-VolumesGetTest-1443487843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0e209eb2-bdbf-4f36-bddd-783987bddf29 tempest-VolumesGetTest-1443487843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0e209eb2-bdbf-4f36-bddd-783987bddf29 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0e209eb2-bdbf-4f36-bddd-783987bddf29 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:21 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:04:21 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:21 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a241e0af-9a74-4bb0-9b07-588782e533ef tempest-VolumesGetTest-1443487843 None] Acquiring lock "cinder-c9e7674a-3bcb-4844-b497-650bd8535e3e-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:21 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a241e0af-9a74-4bb0-9b07-588782e533ef tempest-VolumesGetTest-1443487843 None] Lock "cinder-c9e7674a-3bcb-4844-b497-650bd8535e3e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:21 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a241e0af-9a74-4bb0-9b07-588782e533ef tempest-VolumesGetTest-1443487843 None] Acquiring lock "cinder-quobyte-c9e7674a-3bcb-4844-b497-650bd8535e3e" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:21 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a241e0af-9a74-4bb0-9b07-588782e533ef tempest-VolumesGetTest-1443487843 None] Lock "cinder-quobyte-c9e7674a-3bcb-4844-b497-650bd8535e3e" acquired by "delete_volume" :: waited 0.023s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:21 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95ac811-ee84-4b7a-80c9-b7aef592e7e4]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:04:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a241e0af-9a74-4bb0-9b07-588782e533ef tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9e7674a-3bcb-4844-b497-650bd8535e3e {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:21 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0e209eb2-bdbf-4f36-bddd-783987bddf29 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.776s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:21 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-0e209eb2-bdbf-4f36-bddd-783987bddf29 tempest-VolumesGetTest-1443487843 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:04:21 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-0e209eb2-bdbf-4f36-bddd-783987bddf29 tempest-VolumesGetTest-1443487843 None] Deleted volume successfully. Jul 07 22:04:21 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0e209eb2-bdbf-4f36-bddd-783987bddf29 tempest-VolumesGetTest-1443487843 None] Lock "cinder-69ad6beb-0c0b-4a2d-832e-4454a00e5f61-delete_volume" released by "delete_volume" :: held 3.748s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:21 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-44c06699-0735-4f9e-a467-066360818147 tempest-VolumesActionsTest-1449825624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9f1388e9-bed0-4ff2-88ca-e230f973d2c1" returned: 0 in 0.956s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:21 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-44c06699-0735-4f9e-a467-066360818147 tempest-VolumesActionsTest-1449825624 None] Lock "cinder-quobyte-9f1388e9-bed0-4ff2-88ca-e230f973d2c1" released by "delete_volume" :: held 2.420s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:21 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9e7674a-3bcb-4844-b497-650bd8535e3e Jul 07 22:04:21 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:21 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-44c06699-0735-4f9e-a467-066360818147 tempest-VolumesActionsTest-1449825624 None] Created reservations ['680d6bae-c9a7-47ea-bae2-c109c3eafb8d', '16f5e989-dd7a-429c-955a-75108c19332f', '483fadcf-b417-4185-878a-3797113161f9', '87892abf-45ef-4f1d-b56c-9f6be89fde76'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:04:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-44c06699-0735-4f9e-a467-066360818147 tempest-VolumesActionsTest-1449825624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-44c06699-0735-4f9e-a467-066360818147 tempest-VolumesActionsTest-1449825624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-44c06699-0735-4f9e-a467-066360818147 tempest-VolumesActionsTest-1449825624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-44c06699-0735-4f9e-a467-066360818147 tempest-VolumesActionsTest-1449825624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-44c06699-0735-4f9e-a467-066360818147 tempest-VolumesActionsTest-1449825624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-44c06699-0735-4f9e-a467-066360818147 tempest-VolumesActionsTest-1449825624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:22 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:04:22 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:22 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a241e0af-9a74-4bb0-9b07-588782e533ef tempest-VolumesGetTest-1443487843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9e7674a-3bcb-4844-b497-650bd8535e3e" returned: 0 in 0.930s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a241e0af-9a74-4bb0-9b07-588782e533ef tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9e7674a-3bcb-4844-b497-650bd8535e3e {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:22 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9e7674a-3bcb-4844-b497-650bd8535e3e Jul 07 22:04:22 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:22 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-44c06699-0735-4f9e-a467-066360818147 tempest-VolumesActionsTest-1449825624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.781s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:22 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-44c06699-0735-4f9e-a467-066360818147 tempest-VolumesActionsTest-1449825624 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:04:22 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-44c06699-0735-4f9e-a467-066360818147 tempest-VolumesActionsTest-1449825624 None] Deleted volume successfully. Jul 07 22:04:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-44c06699-0735-4f9e-a467-066360818147 tempest-VolumesActionsTest-1449825624 None] Lock "cinder-9f1388e9-bed0-4ff2-88ca-e230f973d2c1-delete_volume" released by "delete_volume" :: held 3.474s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:23 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a241e0af-9a74-4bb0-9b07-588782e533ef tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c9e7674a-3bcb-4844-b497-650bd8535e3e" returned: 0 in 0.746s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a241e0af-9a74-4bb0-9b07-588782e533ef tempest-VolumesGetTest-1443487843 None] Lock "cinder-quobyte-c9e7674a-3bcb-4844-b497-650bd8535e3e" released by "delete_volume" :: held 1.747s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Flow 'volume_create_manager' (e6706e28-67b2-4760-9063-2c34afeae468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24332cd9-3c99-4651-84a8-45bac96b8aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24332cd9-3c99-4651-84a8-45bac96b8aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-304805251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c6e5b3-c448-4ff0-8c9a-68315d241550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84800c3ec4a49079e964460ba092274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:04:23Z,use_quota=True,user_id='a58819f043f14c9790b7acfd4d627c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (128b5278-fe6a-40d8-bb43-3899861c370a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (128b5278-fe6a-40d8-bb43-3899861c370a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beba2fb9-eb67-41de-be07-7c7f407fb9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beba2fb9-eb67-41de-be07-7c7f407fb9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75c6e5b3-c448-4ff0-8c9a-68315d241550', 'volume_name': 'volume-75c6e5b3-c448-4ff0-8c9a-68315d241550', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ea9b69-2513-4a3c-ade7-917a19b1c193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ea9b69-2513-4a3c-ade7-917a19b1c193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bfe130b-96e7-44ee-b100-9daeb45cf08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:23 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Volume 75c6e5b3-c448-4ff0-8c9a-68315d241550: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75c6e5b3-c448-4ff0-8c9a-68315d241550', 'volume_size': 1} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-304805251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c6e5b3-c448-4ff0-8c9a-68315d241550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84800c3ec4a49079e964460ba092274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:04:23Z,use_quota=True,user_id='a58819f043f14c9790b7acfd4d627c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Creating volume 75c6e5b3-c448-4ff0-8c9a-68315d241550 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:04:23 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-75c6e5b3-c448-4ff0-8c9a-68315d241550 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:23 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-75c6e5b3-c448-4ff0-8c9a-68315d241550 1073741824 Jul 07 22:04:23 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-a241e0af-9a74-4bb0-9b07-588782e533ef tempest-VolumesGetTest-1443487843 None] Created reservations ['d5f630e1-882b-46b9-a65f-4df5f217ff30', '65f1ed91-0b1f-4795-b447-d4c130b4b1a2', '90b5934f-2730-42aa-a63b-2e3b2164c8d7', 'd7d57776-7a12-4cb9-acff-e21ab759235d'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a241e0af-9a74-4bb0-9b07-588782e533ef tempest-VolumesGetTest-1443487843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a241e0af-9a74-4bb0-9b07-588782e533ef tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a241e0af-9a74-4bb0-9b07-588782e533ef tempest-VolumesGetTest-1443487843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a241e0af-9a74-4bb0-9b07-588782e533ef tempest-VolumesGetTest-1443487843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a241e0af-9a74-4bb0-9b07-588782e533ef tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a241e0af-9a74-4bb0-9b07-588782e533ef tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:23 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:04:23 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:24 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:04:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Flow 'volume_create_manager' (50d317fe-4d91-4ee9-b891-ecf4fb62729a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:04:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81284d4-d887-480e-85d1-e83a2b8801c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b81284d4-d887-480e-85d1-e83a2b8801c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1211185178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a6589e-432b-40b6-8eec-c218e398ae66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4aea704e354c598490def644cd75a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:04:25Z,use_quota=True,user_id='e7187d0881e84c4c8babd32a20babd53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c4791a-7874-4e74-9e10-21ca5a4d2e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c4791a-7874-4e74-9e10-21ca5a4d2e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea418a5-8c0c-47ca-8a19-7eda11552838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea418a5-8c0c-47ca-8a19-7eda11552838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2a6589e-432b-40b6-8eec-c218e398ae66', 'volume_name': 'volume-d2a6589e-432b-40b6-8eec-c218e398ae66', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830d3e65-6c02-4c9d-8326-9a705672b329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830d3e65-6c02-4c9d-8326-9a705672b329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ff6717-44f9-41c2-bbbf-a05e083ea21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:24 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Volume d2a6589e-432b-40b6-8eec-c218e398ae66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2a6589e-432b-40b6-8eec-c218e398ae66', 'volume_size': 1} Jul 07 22:04:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:24 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-75c6e5b3-c448-4ff0-8c9a-68315d241550 1073741824" returned: 0 in 1.281s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:24 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a241e0af-9a74-4bb0-9b07-588782e533ef tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.066s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:24 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-a241e0af-9a74-4bb0-9b07-588782e533ef tempest-VolumesGetTest-1443487843 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:04:24 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-a241e0af-9a74-4bb0-9b07-588782e533ef tempest-VolumesGetTest-1443487843 None] Deleted volume successfully. Jul 07 22:04:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-75c6e5b3-c448-4ff0-8c9a-68315d241550 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a241e0af-9a74-4bb0-9b07-588782e533ef tempest-VolumesGetTest-1443487843 None] Lock "cinder-c9e7674a-3bcb-4844-b497-650bd8535e3e-delete_volume" released by "delete_volume" :: held 3.334s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:25 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-75c6e5b3-c448-4ff0-8c9a-68315d241550 Jul 07 22:04:25 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:25 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-75c6e5b3-c448-4ff0-8c9a-68315d241550" returned: 0 in 0.830s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] <== create_volume: return (2154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:04:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.157s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.968s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1211185178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a6589e-432b-40b6-8eec-c218e398ae66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4aea704e354c598490def644cd75a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:04:25Z,use_quota=True,user_id='e7187d0881e84c4c8babd32a20babd53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:04:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Creating volume d2a6589e-432b-40b6-8eec-c218e398ae66 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:04:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:04:25 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:04:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:25 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66 1073741824 Jul 07 22:04:25 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bfe130b-96e7-44ee-b100-9daeb45cf08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75c6e5b3-c448-4ff0-8c9a-68315d241550', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abff0870-38bd-4e0a-a16e-9edf05c19392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:25 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Volume volume-75c6e5b3-c448-4ff0-8c9a-68315d241550 (75c6e5b3-c448-4ff0-8c9a-68315d241550): created successfully Jul 07 22:04:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abff0870-38bd-4e0a-a16e-9edf05c19392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Flow 'volume_create_manager' (e6706e28-67b2-4760-9063-2c34afeae468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:04:25 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6be02a78-c0fc-4e3f-b37a-df86fb54ecf0 tempest-VolumesActionsTest-56686579 None] Created volume successfully. Jul 07 22:04:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-59558c55-97a9-4d8b-aa5d-7333ab4a4d79 tempest-VolumesActionsTest-1449825624 None] Acquiring lock "cinder-75c6e5b3-c448-4ff0-8c9a-68315d241550-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-59558c55-97a9-4d8b-aa5d-7333ab4a4d79 tempest-VolumesActionsTest-1449825624 None] Lock "cinder-75c6e5b3-c448-4ff0-8c9a-68315d241550-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-59558c55-97a9-4d8b-aa5d-7333ab4a4d79 tempest-VolumesActionsTest-1449825624 None] Acquiring lock "cinder-quobyte-75c6e5b3-c448-4ff0-8c9a-68315d241550" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-59558c55-97a9-4d8b-aa5d-7333ab4a4d79 tempest-VolumesActionsTest-1449825624 None] Lock "cinder-quobyte-75c6e5b3-c448-4ff0-8c9a-68315d241550" acquired by "delete_volume" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:27 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:27 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c26d8e-b60d-40de-bdaa-fec5e286a9bb]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:04:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-59558c55-97a9-4d8b-aa5d-7333ab4a4d79 tempest-VolumesActionsTest-1449825624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-75c6e5b3-c448-4ff0-8c9a-68315d241550 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66 1073741824" returned: 0 in 1.379s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:27 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66 Jul 07 22:04:27 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:27 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-75c6e5b3-c448-4ff0-8c9a-68315d241550 Jul 07 22:04:27 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:28 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66" returned: 0 in 1.024s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] <== create_volume: return (2473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:04:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.476s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ff6717-44f9-41c2-bbbf-a05e083ea21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2a6589e-432b-40b6-8eec-c218e398ae66', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7406f7f1-a0f2-4969-a3be-6aa98229c93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:28 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Volume volume-d2a6589e-432b-40b6-8eec-c218e398ae66 (d2a6589e-432b-40b6-8eec-c218e398ae66): created successfully Jul 07 22:04:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7406f7f1-a0f2-4969-a3be-6aa98229c93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Flow 'volume_create_manager' (50d317fe-4d91-4ee9-b891-ecf4fb62729a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:04:28 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-59558c55-97a9-4d8b-aa5d-7333ab4a4d79 tempest-VolumesActionsTest-1449825624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-75c6e5b3-c448-4ff0-8c9a-68315d241550" returned: 0 in 1.196s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-59558c55-97a9-4d8b-aa5d-7333ab4a4d79 tempest-VolumesActionsTest-1449825624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-75c6e5b3-c448-4ff0-8c9a-68315d241550 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:28 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-06c1f480-e8d4-4351-a4ce-e74d5b1622e1 tempest-VolumesGetTest-1443487843 None] Created volume successfully. Jul 07 22:04:28 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-75c6e5b3-c448-4ff0-8c9a-68315d241550 Jul 07 22:04:28 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:29 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-59558c55-97a9-4d8b-aa5d-7333ab4a4d79 tempest-VolumesActionsTest-1449825624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-75c6e5b3-c448-4ff0-8c9a-68315d241550" returned: 0 in 1.110s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-59558c55-97a9-4d8b-aa5d-7333ab4a4d79 tempest-VolumesActionsTest-1449825624 None] Lock "cinder-quobyte-75c6e5b3-c448-4ff0-8c9a-68315d241550" released by "delete_volume" :: held 2.389s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:29 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-59558c55-97a9-4d8b-aa5d-7333ab4a4d79 tempest-VolumesActionsTest-1449825624 None] Created reservations ['c2cd3c0a-03e8-4933-96bd-9fbc9bf4965f', '0e81813b-6e19-4f52-97f3-4e9bf6f58315', '32d269f4-9ec1-4c60-ba99-e47bfa509c2f', '54d4f8b3-602a-4ef2-aee9-1b9cbe64c45f'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:04:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-59558c55-97a9-4d8b-aa5d-7333ab4a4d79 tempest-VolumesActionsTest-1449825624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-59558c55-97a9-4d8b-aa5d-7333ab4a4d79 tempest-VolumesActionsTest-1449825624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:29 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-59558c55-97a9-4d8b-aa5d-7333ab4a4d79 tempest-VolumesActionsTest-1449825624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:29 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-59558c55-97a9-4d8b-aa5d-7333ab4a4d79 tempest-VolumesActionsTest-1449825624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-59558c55-97a9-4d8b-aa5d-7333ab4a4d79 tempest-VolumesActionsTest-1449825624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-59558c55-97a9-4d8b-aa5d-7333ab4a4d79 tempest-VolumesActionsTest-1449825624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:29 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:04:29 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:30 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:04:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Flow 'volume_create_manager' (51545e7a-1fb5-4bce-80c8-b05c4bc40d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:04:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12d0b5c-ee32-462f-bc1c-a7bfef34c360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12d0b5c-ee32-462f-bc1c-a7bfef34c360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-154560322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a55ca79-7671-4084-8592-630729578274,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9d4aea704e354c598490def644cd75a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d2a6589e-432b-40b6-8eec-c218e398ae66,status='creating',terminated_at=None,updated_at=2026-07-07T20:04:30Z,use_quota=True,user_id='e7187d0881e84c4c8babd32a20babd53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e82a8c6-f33e-467f-bc20-48fa94349fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e82a8c6-f33e-467f-bc20-48fa94349fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36286c16-374e-4d26-b92b-108522172058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36286c16-374e-4d26-b92b-108522172058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0a55ca79-7671-4084-8592-630729578274', 'volume_name': 'volume-0a55ca79-7671-4084-8592-630729578274', 'volume_size': 1, 'source_volid': 'd2a6589e-432b-40b6-8eec-c218e398ae66', 'source_volstatus': 'available'}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c0928a6-27ea-4d1b-9f0a-2cb462f6560c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c0928a6-27ea-4d1b-9f0a-2cb462f6560c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99113e46-49b4-4bc3-828f-3cb1dddf61ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:30 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Volume 0a55ca79-7671-4084-8592-630729578274: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0a55ca79-7671-4084-8592-630729578274', 'volume_size': 1, 'source_volid': 'd2a6589e-432b-40b6-8eec-c218e398ae66', 'source_volstatus': 'available'} Jul 07 22:04:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:30 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Cloning volume d2a6589e-432b-40b6-8eec-c218e398ae66 to volume 0a55ca79-7671-4084-8592-630729578274 Jul 07 22:04:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Creating offline snapshot 434dfb5a-40e2-4b66-b98c-58c03f1da4f3 of volume d2a6589e-432b-40b6-8eec-c218e398ae66 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:04:30 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8466b840-7ea2-4e3a-ac98-ff30e5d6fc14]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:04:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:30 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66 Jul 07 22:04:30 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:31 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-59558c55-97a9-4d8b-aa5d-7333ab4a4d79 tempest-VolumesActionsTest-1449825624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.449s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:31 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-59558c55-97a9-4d8b-aa5d-7333ab4a4d79 tempest-VolumesActionsTest-1449825624 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:04:31 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-59558c55-97a9-4d8b-aa5d-7333ab4a4d79 tempest-VolumesActionsTest-1449825624 None] Deleted volume successfully. Jul 07 22:04:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-59558c55-97a9-4d8b-aa5d-7333ab4a4d79 tempest-VolumesActionsTest-1449825624 None] Lock "cinder-75c6e5b3-c448-4ff0-8c9a-68315d241550-delete_volume" released by "delete_volume" :: held 4.301s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:32 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:04:32 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Flow 'volume_create_manager' (11de814c-ddf6-4a0f-8188-00d786fcc602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:04:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65fd26bb-08c6-4c7d-80c0-e7725021be5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66" returned: 0 in 1.712s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:32 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3 1G Jul 07 22:04:32 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65fd26bb-08c6-4c7d-80c0-e7725021be5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1722410715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576cd450-5b81-4c02-a233-c9840d5a78e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84800c3ec4a49079e964460ba092274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:04:32Z,use_quota=True,user_id='a58819f043f14c9790b7acfd4d627c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca2d1d9-430b-4655-bbbc-f56fbd8b9622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca2d1d9-430b-4655-bbbc-f56fbd8b9622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468d64a2-e1a4-4546-bfd6-4a41c0456a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468d64a2-e1a4-4546-bfd6-4a41c0456a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '576cd450-5b81-4c02-a233-c9840d5a78e4', 'volume_name': 'volume-576cd450-5b81-4c02-a233-c9840d5a78e4', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4687d8af-8e3b-406d-ae53-de42678bae1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4687d8af-8e3b-406d-ae53-de42678bae1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21af7bb1-3638-4156-8044-f2ba8d3052e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:32 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Volume 576cd450-5b81-4c02-a233-c9840d5a78e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-576cd450-5b81-4c02-a233-c9840d5a78e4', 'volume_size': 1} Jul 07 22:04:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:33 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3 1G" returned: 0 in 1.082s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2a6589e-432b-40b6-8eec-c218e398ae66 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:33 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2a6589e-432b-40b6-8eec-c218e398ae66 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3 Jul 07 22:04:33 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:34 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2a6589e-432b-40b6-8eec-c218e398ae66 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3" returned: 0 in 0.896s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:34 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3 is being set with open permissions: ugo+rw Jul 07 22:04:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:34 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3 Jul 07 22:04:34 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:35 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3" returned: 0 in 1.284s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:35 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.info Jul 07 22:04:35 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:04:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:35 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:04:35 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:36 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.info" returned: 0 in 0.752s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:36 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.info is being set with open permissions: ugo+rw Jul 07 22:04:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:36 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.info Jul 07 22:04:36 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:36 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.818s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:04:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:04:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 28 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 22:04:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 22:04:36 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.info" returned: 0 in 0.756s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Acquiring lock "cinder-quobyte-0a55ca79-7671-4084-8592-630729578274" by "_copy_volume_from_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Lock "cinder-quobyte-0a55ca79-7671-4084-8592-630729578274" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] snapshot: 434dfb5a-40e2-4b66-b98c-58c03f1da4f3, volume: 0a55ca79-7671-4084-8592-630729578274, {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:04:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:37 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae011c7a-89a3-4459-9f1c-c513652adc92]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:04:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:37 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3 Jul 07 22:04:37 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:38 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3" returned: 0 in 1.056s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:38 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2a6589e-432b-40b6-8eec-c218e398ae66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:04:38 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66 {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:04:38 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Creating direct copy from snapshot {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:04:38 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6a3878-f4b3-41b8-b9fd-28ccbb5b7136]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:04:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:38 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66 Jul 07 22:04:38 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:39 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66" returned: 0 in 0.894s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:39 devstack cinder-volume[87586]: DEBUG cinder.utils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Path /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a55ca79-7671-4084-8592-630729578274 not found in is_blk_device check {{(pid=87586) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:04:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a55ca79-7671-4084-8592-630729578274 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:39 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a55ca79-7671-4084-8592-630729578274 Jul 07 22:04:39 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:45 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a55ca79-7671-4084-8592-630729578274" returned: 0 in 6.188s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:45 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2113a16c-ea8a-483c-a842-6e5f0ef9d0e7]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:04:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:45 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66 Jul 07 22:04:45 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:45 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=84,cinder:UPDATE=109,cinder:INSERT=21,cinder:DELETE=12 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:04:45 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=78,cinder:UPDATE=112,cinder:DELETE=7,cinder:INSERT=32 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:04:46 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66" returned: 0 in 0.965s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:46 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Image conversion details: src /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a55ca79-7671-4084-8592-630729578274 {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:04:46 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Converted 1024.00 MB image at 165.43 MB/s Jul 07 22:04:46 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a55ca79-7671-4084-8592-630729578274 is being set with open permissions: ugo+rw Jul 07 22:04:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a55ca79-7671-4084-8592-630729578274 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:46 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a55ca79-7671-4084-8592-630729578274 Jul 07 22:04:46 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:46 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a55ca79-7671-4084-8592-630729578274" returned: 0 in 0.667s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:46 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Lock "cinder-quobyte-0a55ca79-7671-4084-8592-630729578274" released by "_copy_volume_from_snapshot" :: held 9.883s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:46 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Acquiring lock "cinder-quobyte-434dfb5a-40e2-4b66-b98c-58c03f1da4f3" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:46 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Lock "cinder-quobyte-434dfb5a-40e2-4b66-b98c-58c03f1da4f3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:46 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Deleting offline snapshot 434dfb5a-40e2-4b66-b98c-58c03f1da4f3 of volume d2a6589e-432b-40b6-8eec-c218e398ae66 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:04:46 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] snapshot_file for this snap is: volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:04:46 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29ec576-9b1c-4483-86ed-9c7940a1101a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:04:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:47 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3 Jul 07 22:04:47 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:47 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3" returned: 0 in 0.771s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:47 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2a6589e-432b-40b6-8eec-c218e398ae66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:04:47 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c68c744-eacb-45ed-bddb-bb7d231c48ef]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:04:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:47 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66 Jul 07 22:04:47 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:48 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66" returned: 0 in 0.762s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:48 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3 Jul 07 22:04:48 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:49 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3" returned: 0 in 0.856s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:49 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3 Jul 07 22:04:49 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:50 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66.434dfb5a-40e2-4b66-b98c-58c03f1da4f3" returned: 0 in 0.714s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:50 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Lock "cinder-quobyte-434dfb5a-40e2-4b66-b98c-58c03f1da4f3" released by "_delete_snapshot" :: held 3.206s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.808s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.915s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1722410715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576cd450-5b81-4c02-a233-c9840d5a78e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84800c3ec4a49079e964460ba092274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:04:32Z,use_quota=True,user_id='a58819f043f14c9790b7acfd4d627c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:04:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Creating volume 576cd450-5b81-4c02-a233-c9840d5a78e4 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:04:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:04:50 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:04:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-576cd450-5b81-4c02-a233-c9840d5a78e4 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:50 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-576cd450-5b81-4c02-a233-c9840d5a78e4 1073741824 Jul 07 22:04:50 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99113e46-49b4-4bc3-828f-3cb1dddf61ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a55ca79-7671-4084-8592-630729578274', 'volume_size': 1, 'source_volid': 'd2a6589e-432b-40b6-8eec-c218e398ae66', 'source_volstatus': 'available'}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2db2c50-f7eb-43c5-9167-a9e6ea0a7fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:50 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Volume volume-0a55ca79-7671-4084-8592-630729578274 (0a55ca79-7671-4084-8592-630729578274): created successfully Jul 07 22:04:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2db2c50-f7eb-43c5-9167-a9e6ea0a7fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Flow 'volume_create_manager' (51545e7a-1fb5-4bce-80c8-b05c4bc40d62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:04:50 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-56d47128-9ae8-4f68-bce3-a0d9147c5447 tempest-VolumesGetTest-1443487843 None] Created volume successfully. Jul 07 22:04:51 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-576cd450-5b81-4c02-a233-c9840d5a78e4 1073741824" returned: 0 in 0.916s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-576cd450-5b81-4c02-a233-c9840d5a78e4 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:51 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-576cd450-5b81-4c02-a233-c9840d5a78e4 Jul 07 22:04:51 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:51 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-576cd450-5b81-4c02-a233-c9840d5a78e4" returned: 0 in 0.664s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21af7bb1-3638-4156-8044-f2ba8d3052e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-576cd450-5b81-4c02-a233-c9840d5a78e4', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb6ccac-f9e1-4903-9bc3-e8c2127d7c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Flow 'volume_create_manager' (f9e29929-0a33-4219-9c47-338eff88aa08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221eb2fe-5e77-4d5c-b579-40a890618d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:51 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Volume volume-576cd450-5b81-4c02-a233-c9840d5a78e4 (576cd450-5b81-4c02-a233-c9840d5a78e4): created successfully Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb6ccac-f9e1-4903-9bc3-e8c2127d7c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Flow 'volume_create_manager' (11de814c-ddf6-4a0f-8188-00d786fcc602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221eb2fe-5e77-4d5c-b579-40a890618d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:04:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-353479386',display_name='tempest-VolumesGetTest-Volume-1393694592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a8f0fbf-5b72-4859-b2d3-f218679ea475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4aea704e354c598490def644cd75a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:04:52Z,use_quota=True,user_id='e7187d0881e84c4c8babd32a20babd53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d49ad78-8980-4c50-ab29-26b507a2aac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d49ad78-8980-4c50-ab29-26b507a2aac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4fe3ca-dfba-489a-881f-c3e950e64075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4fe3ca-dfba-489a-881f-c3e950e64075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a8f0fbf-5b72-4859-b2d3-f218679ea475', 'volume_name': 'volume-3a8f0fbf-5b72-4859-b2d3-f218679ea475', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af03716a-aca3-46ba-8992-423aa52ff424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af03716a-aca3-46ba-8992-423aa52ff424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ce1394-f9d3-4050-ad43-f69dcadfa790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:51 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Volume 3a8f0fbf-5b72-4859-b2d3-f218679ea475: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a8f0fbf-5b72-4859-b2d3-f218679ea475', 'volume_size': 1} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:04:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-353479386',display_name='tempest-VolumesGetTest-Volume-1393694592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a8f0fbf-5b72-4859-b2d3-f218679ea475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4aea704e354c598490def644cd75a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:04:52Z,use_quota=True,user_id='e7187d0881e84c4c8babd32a20babd53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Creating volume 3a8f0fbf-5b72-4859-b2d3-f218679ea475 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:04:51 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:04:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3a8f0fbf-5b72-4859-b2d3-f218679ea475 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:51 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-59174494-0f8b-483e-9c2e-7d0ae75b796f tempest-VolumesActionsTest-56686579 None] Created volume successfully. Jul 07 22:04:51 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3a8f0fbf-5b72-4859-b2d3-f218679ea475 1073741824 Jul 07 22:04:51 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:52 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3a8f0fbf-5b72-4859-b2d3-f218679ea475 1073741824" returned: 0 in 0.825s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3a8f0fbf-5b72-4859-b2d3-f218679ea475 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:52 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3a8f0fbf-5b72-4859-b2d3-f218679ea475 Jul 07 22:04:52 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:53 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e4cba2d0-b567-4602-b47d-90b267902cde tempest-VolumesActionsTest-1449825624 None] Acquiring lock "cinder-576cd450-5b81-4c02-a233-c9840d5a78e4-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:53 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e4cba2d0-b567-4602-b47d-90b267902cde tempest-VolumesActionsTest-1449825624 None] Lock "cinder-576cd450-5b81-4c02-a233-c9840d5a78e4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:53 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e4cba2d0-b567-4602-b47d-90b267902cde tempest-VolumesActionsTest-1449825624 None] Acquiring lock "cinder-quobyte-576cd450-5b81-4c02-a233-c9840d5a78e4" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:53 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e4cba2d0-b567-4602-b47d-90b267902cde tempest-VolumesActionsTest-1449825624 None] Lock "cinder-quobyte-576cd450-5b81-4c02-a233-c9840d5a78e4" acquired by "delete_volume" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:53 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[120dcf4b-8ab4-471f-bfcf-04fe1ece9f70]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:04:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4cba2d0-b567-4602-b47d-90b267902cde tempest-VolumesActionsTest-1449825624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-576cd450-5b81-4c02-a233-c9840d5a78e4 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:53 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3a8f0fbf-5b72-4859-b2d3-f218679ea475" returned: 0 in 0.674s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:53 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:04:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ce1394-f9d3-4050-ad43-f69dcadfa790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a8f0fbf-5b72-4859-b2d3-f218679ea475', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0996a0bc-a000-4b4a-803f-5b070d59b531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:53 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Volume volume-3a8f0fbf-5b72-4859-b2d3-f218679ea475 (3a8f0fbf-5b72-4859-b2d3-f218679ea475): created successfully Jul 07 22:04:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0996a0bc-a000-4b4a-803f-5b070d59b531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:53 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-576cd450-5b81-4c02-a233-c9840d5a78e4 Jul 07 22:04:53 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Flow 'volume_create_manager' (f9e29929-0a33-4219-9c47-338eff88aa08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:04:53 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d3c9aaee-8e8d-4375-85b7-e56a070de088 tempest-VolumesGetTest-1443487843 None] Created volume successfully. Jul 07 22:04:54 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e8785cc5-5f9a-47fa-9f26-35982dddad77 tempest-VolumesGetTest-1443487843 None] Acquiring lock "cinder-3a8f0fbf-5b72-4859-b2d3-f218679ea475-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:54 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e8785cc5-5f9a-47fa-9f26-35982dddad77 tempest-VolumesGetTest-1443487843 None] Lock "cinder-3a8f0fbf-5b72-4859-b2d3-f218679ea475-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:54 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e8785cc5-5f9a-47fa-9f26-35982dddad77 tempest-VolumesGetTest-1443487843 None] Acquiring lock "cinder-quobyte-3a8f0fbf-5b72-4859-b2d3-f218679ea475" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:54 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e8785cc5-5f9a-47fa-9f26-35982dddad77 tempest-VolumesGetTest-1443487843 None] Lock "cinder-quobyte-3a8f0fbf-5b72-4859-b2d3-f218679ea475" acquired by "delete_volume" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:54 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[574a301a-37d4-4d1e-a646-7d8e8dbfdad2]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:04:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e8785cc5-5f9a-47fa-9f26-35982dddad77 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3a8f0fbf-5b72-4859-b2d3-f218679ea475 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:54 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4cba2d0-b567-4602-b47d-90b267902cde tempest-VolumesActionsTest-1449825624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-576cd450-5b81-4c02-a233-c9840d5a78e4" returned: 0 in 0.918s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4cba2d0-b567-4602-b47d-90b267902cde tempest-VolumesActionsTest-1449825624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-576cd450-5b81-4c02-a233-c9840d5a78e4 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:54 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-576cd450-5b81-4c02-a233-c9840d5a78e4 Jul 07 22:04:54 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:54 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3a8f0fbf-5b72-4859-b2d3-f218679ea475 Jul 07 22:04:54 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:55 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e8785cc5-5f9a-47fa-9f26-35982dddad77 tempest-VolumesGetTest-1443487843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3a8f0fbf-5b72-4859-b2d3-f218679ea475" returned: 0 in 0.900s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e8785cc5-5f9a-47fa-9f26-35982dddad77 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3a8f0fbf-5b72-4859-b2d3-f218679ea475 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:55 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3a8f0fbf-5b72-4859-b2d3-f218679ea475 Jul 07 22:04:55 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:55 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4cba2d0-b567-4602-b47d-90b267902cde tempest-VolumesActionsTest-1449825624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-576cd450-5b81-4c02-a233-c9840d5a78e4" returned: 0 in 0.840s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:55 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e4cba2d0-b567-4602-b47d-90b267902cde tempest-VolumesActionsTest-1449825624 None] Lock "cinder-quobyte-576cd450-5b81-4c02-a233-c9840d5a78e4" released by "delete_volume" :: held 1.814s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:55 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-e4cba2d0-b567-4602-b47d-90b267902cde tempest-VolumesActionsTest-1449825624 None] Created reservations ['f8230265-cb45-4850-8fa5-682f709f7b05', '75fcf9ff-5728-493c-8a3b-e07a6f18dbe9', '4c88a07d-2625-4bec-a275-87c65d99ff4f', '69344076-7332-4403-8f53-c8c9bcce63a6'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:04:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e4cba2d0-b567-4602-b47d-90b267902cde tempest-VolumesActionsTest-1449825624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e4cba2d0-b567-4602-b47d-90b267902cde tempest-VolumesActionsTest-1449825624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e4cba2d0-b567-4602-b47d-90b267902cde tempest-VolumesActionsTest-1449825624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e4cba2d0-b567-4602-b47d-90b267902cde tempest-VolumesActionsTest-1449825624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e4cba2d0-b567-4602-b47d-90b267902cde tempest-VolumesActionsTest-1449825624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4cba2d0-b567-4602-b47d-90b267902cde tempest-VolumesActionsTest-1449825624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:55 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:04:55 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:56 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e8785cc5-5f9a-47fa-9f26-35982dddad77 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3a8f0fbf-5b72-4859-b2d3-f218679ea475" returned: 0 in 0.915s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e8785cc5-5f9a-47fa-9f26-35982dddad77 tempest-VolumesGetTest-1443487843 None] Lock "cinder-quobyte-3a8f0fbf-5b72-4859-b2d3-f218679ea475" released by "delete_volume" :: held 1.890s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-e8785cc5-5f9a-47fa-9f26-35982dddad77 tempest-VolumesGetTest-1443487843 None] Created reservations ['3f089cf3-604c-470f-bac5-51741cf88d3c', '48096050-6a78-49b9-9e5b-f9f881e5b5ee', 'ad620b2c-929c-4c0d-bab5-5b2f67dcd6f9', '999e043b-48b3-4b1e-98d8-185fcdae62bc'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Flow 'volume_create_manager' (70fec5ea-4b23-47a4-b92d-92b58e308156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb31dc53-68cc-4c21-a1b5-78d19e3c8162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:56 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4cba2d0-b567-4602-b47d-90b267902cde tempest-VolumesActionsTest-1449825624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.000s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-e4cba2d0-b567-4602-b47d-90b267902cde tempest-VolumesActionsTest-1449825624 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb31dc53-68cc-4c21-a1b5-78d19e3c8162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-861603710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84800c3ec4a49079e964460ba092274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:04:56Z,use_quota=True,user_id='a58819f043f14c9790b7acfd4d627c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673c0b03-199a-488b-bf7d-e01d3d60c33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673c0b03-199a-488b-bf7d-e01d3d60c33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584a0c90-e39a-4604-a093-9bf5cfeca53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584a0c90-e39a-4604-a093-9bf5cfeca53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c', 'volume_name': 'volume-7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91fb05ae-c08d-4608-8f23-c4179ae8d180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91fb05ae-c08d-4608-8f23-c4179ae8d180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054d84db-d7b3-40a8-8fbb-8a1eac1c8329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:56 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Volume 7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c', 'volume_size': 1} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-861603710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84800c3ec4a49079e964460ba092274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:04:56Z,use_quota=True,user_id='a58819f043f14c9790b7acfd4d627c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Creating volume 7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:04:56 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:56 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-e4cba2d0-b567-4602-b47d-90b267902cde tempest-VolumesActionsTest-1449825624 None] Deleted volume successfully. Jul 07 22:04:56 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c 1073741824 Jul 07 22:04:56 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e4cba2d0-b567-4602-b47d-90b267902cde tempest-VolumesActionsTest-1449825624 None] Lock "cinder-576cd450-5b81-4c02-a233-c9840d5a78e4-delete_volume" released by "delete_volume" :: held 3.282s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e8785cc5-5f9a-47fa-9f26-35982dddad77 tempest-VolumesGetTest-1443487843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e8785cc5-5f9a-47fa-9f26-35982dddad77 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e8785cc5-5f9a-47fa-9f26-35982dddad77 tempest-VolumesGetTest-1443487843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e8785cc5-5f9a-47fa-9f26-35982dddad77 tempest-VolumesGetTest-1443487843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e8785cc5-5f9a-47fa-9f26-35982dddad77 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e8785cc5-5f9a-47fa-9f26-35982dddad77 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:56 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:04:56 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6f959b82-2e55-49de-b372-c547bde2c959 tempest-VolumesGetTest-1443487843 None] Acquiring lock "cinder-0a55ca79-7671-4084-8592-630729578274-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6f959b82-2e55-49de-b372-c547bde2c959 tempest-VolumesGetTest-1443487843 None] Lock "cinder-0a55ca79-7671-4084-8592-630729578274-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6f959b82-2e55-49de-b372-c547bde2c959 tempest-VolumesGetTest-1443487843 None] Acquiring lock "cinder-quobyte-0a55ca79-7671-4084-8592-630729578274" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6f959b82-2e55-49de-b372-c547bde2c959 tempest-VolumesGetTest-1443487843 None] Lock "cinder-quobyte-0a55ca79-7671-4084-8592-630729578274" acquired by "delete_volume" :: waited 0.030s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1e519c-7491-481d-8dc8-5ca6a7d64b66]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:04:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f959b82-2e55-49de-b372-c547bde2c959 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a55ca79-7671-4084-8592-630729578274 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:56 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a55ca79-7671-4084-8592-630729578274 Jul 07 22:04:56 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-55dc63ca-b383-435f-b088-bf6bd96dfb6a req-a2abe534-be17-43f6-847d-f081af42828a tempest-TestServerVolumeAttachmentScenario-1005538216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:57 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e8785cc5-5f9a-47fa-9f26-35982dddad77 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.784s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:57 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-e8785cc5-5f9a-47fa-9f26-35982dddad77 tempest-VolumesGetTest-1443487843 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:04:57 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-e8785cc5-5f9a-47fa-9f26-35982dddad77 tempest-VolumesGetTest-1443487843 None] Deleted volume successfully. Jul 07 22:04:57 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e8785cc5-5f9a-47fa-9f26-35982dddad77 tempest-VolumesGetTest-1443487843 None] Lock "cinder-3a8f0fbf-5b72-4859-b2d3-f218679ea475-delete_volume" released by "delete_volume" :: held 3.275s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:57 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c 1073741824" returned: 0 in 1.080s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:57 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c Jul 07 22:04:57 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:57 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f959b82-2e55-49de-b372-c547bde2c959 tempest-VolumesGetTest-1443487843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a55ca79-7671-4084-8592-630729578274" returned: 0 in 0.872s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f959b82-2e55-49de-b372-c547bde2c959 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a55ca79-7671-4084-8592-630729578274 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:57 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a55ca79-7671-4084-8592-630729578274 Jul 07 22:04:57 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:58 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c" returned: 0 in 0.666s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:04:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-55dc63ca-b383-435f-b088-bf6bd96dfb6a req-a2abe534-be17-43f6-847d-f081af42828a tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.220s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054d84db-d7b3-40a8-8fbb-8a1eac1c8329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bc4b6f-d16c-422f-b24b-053a1849b578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:04:58 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a26df38-4c20-4e49-b22c-540d531ebcc4]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:04:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-55dc63ca-b383-435f-b088-bf6bd96dfb6a req-a2abe534-be17-43f6-847d-f081af42828a tempest-TestServerVolumeAttachmentScenario-1005538216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4758e8c2-8235-46e1-8bea-2730b056e6b1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:58 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f959b82-2e55-49de-b372-c547bde2c959 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0a55ca79-7671-4084-8592-630729578274" returned: 0 in 0.671s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:58 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6f959b82-2e55-49de-b372-c547bde2c959 tempest-VolumesGetTest-1443487843 None] Lock "cinder-quobyte-0a55ca79-7671-4084-8592-630729578274" released by "delete_volume" :: held 1.599s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:58 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Volume volume-7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c (7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c): created successfully Jul 07 22:04:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bc4b6f-d16c-422f-b24b-053a1849b578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:04:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Flow 'volume_create_manager' (70fec5ea-4b23-47a4-b92d-92b58e308156) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:04:58 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-7860a3f6-933e-4068-a5e2-986c3488be4a tempest-VolumesActionsTest-56686579 None] Created volume successfully. Jul 07 22:04:58 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-6f959b82-2e55-49de-b372-c547bde2c959 tempest-VolumesGetTest-1443487843 None] Created reservations ['4a29f036-17de-4980-a91e-5c64f5a68810', '75e5feac-6095-4fe8-ac6d-98efd5c813af', 'aeb4e54e-812d-4956-b063-2e81aeb6bb1a', '06a1bb35-8912-44db-abd3-3dafff3a7bbc'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:04:58 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4758e8c2-8235-46e1-8bea-2730b056e6b1 Jul 07 22:04:58 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6f959b82-2e55-49de-b372-c547bde2c959 tempest-VolumesGetTest-1443487843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:04:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6f959b82-2e55-49de-b372-c547bde2c959 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:04:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6f959b82-2e55-49de-b372-c547bde2c959 tempest-VolumesGetTest-1443487843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:04:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6f959b82-2e55-49de-b372-c547bde2c959 tempest-VolumesGetTest-1443487843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:04:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6f959b82-2e55-49de-b372-c547bde2c959 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f959b82-2e55-49de-b372-c547bde2c959 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:58 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:04:58 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-987df731-1f6e-44f5-8d22-c9157c82a071 tempest-VolumesGetTest-1443487843 None] Acquiring lock "cinder-d2a6589e-432b-40b6-8eec-c218e398ae66-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-987df731-1f6e-44f5-8d22-c9157c82a071 tempest-VolumesGetTest-1443487843 None] Lock "cinder-d2a6589e-432b-40b6-8eec-c218e398ae66-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-987df731-1f6e-44f5-8d22-c9157c82a071 tempest-VolumesGetTest-1443487843 None] Acquiring lock "cinder-quobyte-d2a6589e-432b-40b6-8eec-c218e398ae66" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-987df731-1f6e-44f5-8d22-c9157c82a071 tempest-VolumesGetTest-1443487843 None] Lock "cinder-quobyte-d2a6589e-432b-40b6-8eec-c218e398ae66" acquired by "delete_volume" :: waited 0.022s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:59 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f959b82-2e55-49de-b372-c547bde2c959 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.685s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:59 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-6f959b82-2e55-49de-b372-c547bde2c959 tempest-VolumesGetTest-1443487843 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:04:59 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a519037-9cea-4b0c-b349-be0df076c58a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:04:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-987df731-1f6e-44f5-8d22-c9157c82a071 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:59 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6f959b82-2e55-49de-b372-c547bde2c959 tempest-VolumesGetTest-1443487843 None] Deleted volume successfully. Jul 07 22:04:59 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Jul 07 22:04:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-55dc63ca-b383-435f-b088-bf6bd96dfb6a req-a2abe534-be17-43f6-847d-f081af42828a tempest-TestServerVolumeAttachmentScenario-1005538216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4758e8c2-8235-46e1-8bea-2730b056e6b1" returned: 0 in 0.886s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:04:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-55dc63ca-b383-435f-b088-bf6bd96dfb6a req-a2abe534-be17-43f6-847d-f081af42828a tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.917s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:04:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6f959b82-2e55-49de-b372-c547bde2c959 tempest-VolumesGetTest-1443487843 None] Lock "cinder-0a55ca79-7671-4084-8592-630729578274-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:04:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-55dc63ca-b383-435f-b088-bf6bd96dfb6a req-a2abe534-be17-43f6-847d-f081af42828a tempest-TestServerVolumeAttachmentScenario-1005538216 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491', 'name': 'volume-4758e8c2-8235-46e1-8bea-2730b056e6b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f33aad35-9288-4d86-bf99-0ba7c6c1adce', 'enforce_multipath': True} {{(pid=87586) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4930}} Jul 07 22:04:59 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66 Jul 07 22:04:59 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:04:59 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-55dc63ca-b383-435f-b088-bf6bd96dfb6a req-a2abe534-be17-43f6-847d-f081af42828a tempest-TestServerVolumeAttachmentScenario-1005538216 None] attachment_update completed successfully. Jul 07 22:04:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-423a12c5-5084-45d5-920a-1fc80c78d332 tempest-VolumesActionsTest-1449825624 None] Acquiring lock "cinder-7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-423a12c5-5084-45d5-920a-1fc80c78d332 tempest-VolumesActionsTest-1449825624 None] Lock "cinder-7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-423a12c5-5084-45d5-920a-1fc80c78d332 tempest-VolumesActionsTest-1449825624 None] Acquiring lock "cinder-quobyte-7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:04:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-423a12c5-5084-45d5-920a-1fc80c78d332 tempest-VolumesActionsTest-1449825624 None] Lock "cinder-quobyte-7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c" acquired by "delete_volume" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:04:59 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d79dce2-6752-494b-b906-9bd65300d5c1]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:04:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-423a12c5-5084-45d5-920a-1fc80c78d332 tempest-VolumesActionsTest-1449825624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:04:59 devstack sudo[98854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c Jul 07 22:04:59 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:00 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-987df731-1f6e-44f5-8d22-c9157c82a071 tempest-VolumesGetTest-1443487843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66" returned: 0 in 1.105s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-987df731-1f6e-44f5-8d22-c9157c82a071 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:00 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66 Jul 07 22:05:00 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:00 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-423a12c5-5084-45d5-920a-1fc80c78d332 tempest-VolumesActionsTest-1449825624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c" returned: 0 in 1.298s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-423a12c5-5084-45d5-920a-1fc80c78d332 tempest-VolumesActionsTest-1449825624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:00 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c Jul 07 22:05:00 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:01 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-987df731-1f6e-44f5-8d22-c9157c82a071 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d2a6589e-432b-40b6-8eec-c218e398ae66" returned: 0 in 0.932s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:01 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-987df731-1f6e-44f5-8d22-c9157c82a071 tempest-VolumesGetTest-1443487843 None] Lock "cinder-quobyte-d2a6589e-432b-40b6-8eec-c218e398ae66" released by "delete_volume" :: held 2.112s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:05:01 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-987df731-1f6e-44f5-8d22-c9157c82a071 tempest-VolumesGetTest-1443487843 None] Created reservations ['ebf97ea4-76c4-4fea-80e9-de332c354d9e', '4e43cd5c-7008-4057-9244-27ffe6a822bc', 'dee44e52-bcd9-424e-b4f9-c1393d5ba707', '2a7b9aeb-ead2-458d-93b4-9c65d799599f'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:05:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-987df731-1f6e-44f5-8d22-c9157c82a071 tempest-VolumesGetTest-1443487843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-987df731-1f6e-44f5-8d22-c9157c82a071 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:01 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-987df731-1f6e-44f5-8d22-c9157c82a071 tempest-VolumesGetTest-1443487843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:05:01 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-987df731-1f6e-44f5-8d22-c9157c82a071 tempest-VolumesGetTest-1443487843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:05:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-987df731-1f6e-44f5-8d22-c9157c82a071 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-987df731-1f6e-44f5-8d22-c9157c82a071 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:01 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:05:01 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:01 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-423a12c5-5084-45d5-920a-1fc80c78d332 tempest-VolumesActionsTest-1449825624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c" returned: 0 in 0.723s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:01 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-423a12c5-5084-45d5-920a-1fc80c78d332 tempest-VolumesActionsTest-1449825624 None] Lock "cinder-quobyte-7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c" released by "delete_volume" :: held 2.066s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:05:01 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-423a12c5-5084-45d5-920a-1fc80c78d332 tempest-VolumesActionsTest-1449825624 None] Created reservations ['563974cd-d9b1-417f-a584-60bb5710d554', '93ec6727-6deb-4d64-a363-d245689f762b', 'e6ff3b3c-6781-49cb-b279-4f93f262fb46', '5dbd70ac-afa0-4ede-baac-853136fc7353'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:05:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-423a12c5-5084-45d5-920a-1fc80c78d332 tempest-VolumesActionsTest-1449825624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-423a12c5-5084-45d5-920a-1fc80c78d332 tempest-VolumesActionsTest-1449825624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:01 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-423a12c5-5084-45d5-920a-1fc80c78d332 tempest-VolumesActionsTest-1449825624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:05:01 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-423a12c5-5084-45d5-920a-1fc80c78d332 tempest-VolumesActionsTest-1449825624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:05:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-423a12c5-5084-45d5-920a-1fc80c78d332 tempest-VolumesActionsTest-1449825624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-423a12c5-5084-45d5-920a-1fc80c78d332 tempest-VolumesActionsTest-1449825624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:01 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:05:01 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:02 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-987df731-1f6e-44f5-8d22-c9157c82a071 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.746s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:02 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-987df731-1f6e-44f5-8d22-c9157c82a071 tempest-VolumesGetTest-1443487843 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:05:02 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-987df731-1f6e-44f5-8d22-c9157c82a071 tempest-VolumesGetTest-1443487843 None] Deleted volume successfully. Jul 07 22:05:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-987df731-1f6e-44f5-8d22-c9157c82a071 tempest-VolumesGetTest-1443487843 None] Lock "cinder-d2a6589e-432b-40b6-8eec-c218e398ae66-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:05:02 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-423a12c5-5084-45d5-920a-1fc80c78d332 tempest-VolumesActionsTest-1449825624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.712s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:02 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-423a12c5-5084-45d5-920a-1fc80c78d332 tempest-VolumesActionsTest-1449825624 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:05:02 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-423a12c5-5084-45d5-920a-1fc80c78d332 tempest-VolumesActionsTest-1449825624 None] Deleted volume successfully. Jul 07 22:05:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-423a12c5-5084-45d5-920a-1fc80c78d332 tempest-VolumesActionsTest-1449825624 None] Lock "cinder-7ad406b4-31c4-421a-a3f4-e9b3ef4e1d0c-delete_volume" released by "delete_volume" :: held 3.080s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Flow 'volume_create_manager' (e84ccc72-7687-478a-a7e1-b16efbfcf622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53ba13b-fa0c-40e6-baed-64f06a1a8999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53ba13b-fa0c-40e6-baed-64f06a1a8999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1272247808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf5d4201-53d6-49ea-a7c8-a951487ea929,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9d4aea704e354c598490def644cd75a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:05:03Z,use_quota=True,user_id='e7187d0881e84c4c8babd32a20babd53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2845407-4c39-4bc4-89f1-1b5b4029456d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2845407-4c39-4bc4-89f1-1b5b4029456d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03264c8b-d1ed-4aa3-9249-8ff7e8d7f9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.image.glance [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Creating Keystone auth plugin from conf {{(pid=87586) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Flow 'volume_create_manager' (e67e197f-8f79-426e-a1a7-018c6d445917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81518561-4ef2-4803-a663-2044de8c3e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81518561-4ef2-4803-a663-2044de8c3e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-790839301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d65250-1cfe-44b6-9e90-a2b75a72effe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84800c3ec4a49079e964460ba092274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:05:04Z,use_quota=True,user_id='a58819f043f14c9790b7acfd4d627c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4e884b-6dfa-4935-a30f-6329e0b4fd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4e884b-6dfa-4935-a30f-6329e0b4fd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c3ce752-e2b6-4190-8e4a-39ede47e7d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c3ce752-e2b6-4190-8e4a-39ede47e7d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13d65250-1cfe-44b6-9e90-a2b75a72effe', 'volume_name': 'volume-13d65250-1cfe-44b6-9e90-a2b75a72effe', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa76b7e-0344-415d-8e8d-ca967aef70ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa76b7e-0344-415d-8e8d-ca967aef70ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625e4e3a-df78-406c-9144-1e7af791b0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:03 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Volume 13d65250-1cfe-44b6-9e90-a2b75a72effe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13d65250-1cfe-44b6-9e90-a2b75a72effe', 'volume_size': 1} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-790839301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d65250-1cfe-44b6-9e90-a2b75a72effe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84800c3ec4a49079e964460ba092274',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:05:04Z,use_quota=True,user_id='a58819f043f14c9790b7acfd4d627c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Creating volume 13d65250-1cfe-44b6-9e90-a2b75a72effe {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:05:03 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-13d65250-1cfe-44b6-9e90-a2b75a72effe 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:03 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-13d65250-1cfe-44b6-9e90-a2b75a72effe 1073741824 Jul 07 22:05:03 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03264c8b-d1ed-4aa3-9249-8ff7e8d7f9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bf5d4201-53d6-49ea-a7c8-a951487ea929', 'volume_name': 'volume-bf5d4201-53d6-49ea-a7c8-a951487ea929', 'volume_size': 1, 'image_id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '922c2d549e794c9ebc74bddfbafcb8e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'created_at': datetime.datetime(2026, 7, 7, 19, 46, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 19, 46, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e41f68fc-01f7-4ce3-bdbc-15780de90c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e41f68fc-01f7-4ce3-bdbc-15780de90c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb5abdb-80e8-49ef-814f-83c37e9c0bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:03 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Volume bf5d4201-53d6-49ea-a7c8-a951487ea929: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bf5d4201-53d6-49ea-a7c8-a951487ea929', 'volume_size': 1, 'image_id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '922c2d549e794c9ebc74bddfbafcb8e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'created_at': datetime.datetime(2026, 7, 7, 19, 46, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 19, 46, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 22:05:03 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Trying to clone bf5d4201-53d6-49ea-a7c8-a951487ea929 from image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d at location (None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}]). {{(pid=87586) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:05:04 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_cf9d08ysdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:05:04 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Image download 20.69 MB at 20.69 MB/s Jul 07 22:05:04 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[45234286-7001-466d-bcc3-dee8e3da143c]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_cf9d08ysdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:04 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_cf9d08ysdevstack@QuobyteHD Jul 07 22:05:04 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:05 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-13d65250-1cfe-44b6-9e90-a2b75a72effe 1073741824" returned: 0 in 1.688s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-13d65250-1cfe-44b6-9e90-a2b75a72effe {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:05 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-13d65250-1cfe-44b6-9e90-a2b75a72effe Jul 07 22:05:05 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:05 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_cf9d08ysdevstack@QuobyteHD" returned: 0 in 1.209s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:05 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Temporary image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d is fetched for user e7187d0881e84c4c8babd32a20babd53. {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:05:06 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[de602f5f-165d-4c08-9293-454f712e779d]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_cf9d08ysdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:06 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_cf9d08ysdevstack@QuobyteHD Jul 07 22:05:06 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:06 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-13d65250-1cfe-44b6-9e90-a2b75a72effe" returned: 0 in 1.161s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] <== create_volume: return (2948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:05:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.951s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625e4e3a-df78-406c-9144-1e7af791b0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13d65250-1cfe-44b6-9e90-a2b75a72effe', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ef8c26-b864-443c-b6d5-944dbf34cdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:06 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Volume volume-13d65250-1cfe-44b6-9e90-a2b75a72effe (13d65250-1cfe-44b6-9e90-a2b75a72effe): created successfully Jul 07 22:05:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ef8c26-b864-443c-b6d5-944dbf34cdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Flow 'volume_create_manager' (e67e197f-8f79-426e-a1a7-018c6d445917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:05:06 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-58d240b6-1917-40d2-a6db-b8444e3aa472 tempest-VolumesActionsTest-56686579 None] Created volume successfully. Jul 07 22:05:07 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_cf9d08ysdevstack@QuobyteHD" returned: 0 in 0.971s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1272247808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf5d4201-53d6-49ea-a7c8-a951487ea929,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9d4aea704e354c598490def644cd75a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:05:03Z,use_quota=True,user_id='e7187d0881e84c4c8babd32a20babd53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:05:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Creating volume bf5d4201-53d6-49ea-a7c8-a951487ea929 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:05:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:05:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:05:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:05:07 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:05:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:07 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929 1073741824 Jul 07 22:05:07 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-63ab11b0-d6a5-45ff-b535-d8eec7e4189d tempest-VolumesActionsTest-56686579 None] Acquiring lock "cinder-13d65250-1cfe-44b6-9e90-a2b75a72effe-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:05:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-63ab11b0-d6a5-45ff-b535-d8eec7e4189d tempest-VolumesActionsTest-56686579 None] Lock "cinder-13d65250-1cfe-44b6-9e90-a2b75a72effe-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:05:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-63ab11b0-d6a5-45ff-b535-d8eec7e4189d tempest-VolumesActionsTest-56686579 None] Acquiring lock "cinder-quobyte-13d65250-1cfe-44b6-9e90-a2b75a72effe" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:05:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-63ab11b0-d6a5-45ff-b535-d8eec7e4189d tempest-VolumesActionsTest-56686579 None] Lock "cinder-quobyte-13d65250-1cfe-44b6-9e90-a2b75a72effe" acquired by "delete_volume" :: waited 0.021s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:05:08 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f677af0-5ea7-4859-a920-f7d96c4c19aa]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-63ab11b0-d6a5-45ff-b535-d8eec7e4189d tempest-VolumesActionsTest-56686579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-13d65250-1cfe-44b6-9e90-a2b75a72effe {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:08 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-13d65250-1cfe-44b6-9e90-a2b75a72effe Jul 07 22:05:08 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:08 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929 1073741824" returned: 0 in 1.403s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:08 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929 Jul 07 22:05:08 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:09 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-63ab11b0-d6a5-45ff-b535-d8eec7e4189d tempest-VolumesActionsTest-56686579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-13d65250-1cfe-44b6-9e90-a2b75a72effe" returned: 0 in 1.036s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-63ab11b0-d6a5-45ff-b535-d8eec7e4189d tempest-VolumesActionsTest-56686579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-13d65250-1cfe-44b6-9e90-a2b75a72effe {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:09 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-13d65250-1cfe-44b6-9e90-a2b75a72effe Jul 07 22:05:09 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:09 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929" returned: 0 in 0.697s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:05:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.167s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:09 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Attempting download of 3ab6a905-2c25-4ca7-8034-1de3dbd6512d ((None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}])) to volume bf5d4201-53d6-49ea-a7c8-a951487ea929. {{(pid=87586) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:05:09 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc17bb6-9726-4e08-841c-19b368a6063f]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_l6l124vu {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:09 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_l6l124vu Jul 07 22:05:09 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:09 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-63ab11b0-d6a5-45ff-b535-d8eec7e4189d tempest-VolumesActionsTest-56686579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-13d65250-1cfe-44b6-9e90-a2b75a72effe" returned: 0 in 0.674s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:09 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-63ab11b0-d6a5-45ff-b535-d8eec7e4189d tempest-VolumesActionsTest-56686579 None] Lock "cinder-quobyte-13d65250-1cfe-44b6-9e90-a2b75a72effe" released by "delete_volume" :: held 1.780s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:05:09 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-63ab11b0-d6a5-45ff-b535-d8eec7e4189d tempest-VolumesActionsTest-56686579 None] Created reservations ['0e417e73-1fe4-4697-9784-ea12335d361d', '22d956ec-32ee-421f-8dd5-bf9bf414f64f', '606c4cfd-b0b9-483a-a3cd-15e6b7e44eb4', 'e196bb1e-5dca-4100-9463-7d9190b6967e'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:05:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-63ab11b0-d6a5-45ff-b535-d8eec7e4189d tempest-VolumesActionsTest-56686579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-63ab11b0-d6a5-45ff-b535-d8eec7e4189d tempest-VolumesActionsTest-56686579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-63ab11b0-d6a5-45ff-b535-d8eec7e4189d tempest-VolumesActionsTest-56686579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:05:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-63ab11b0-d6a5-45ff-b535-d8eec7e4189d tempest-VolumesActionsTest-56686579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:05:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-63ab11b0-d6a5-45ff-b535-d8eec7e4189d tempest-VolumesActionsTest-56686579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-63ab11b0-d6a5-45ff-b535-d8eec7e4189d tempest-VolumesActionsTest-56686579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:10 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:05:10 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:10 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_l6l124vu" returned: 0 in 0.861s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_l6l124vu {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:10 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_l6l124vu Jul 07 22:05:10 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:10 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-63ab11b0-d6a5-45ff-b535-d8eec7e4189d tempest-VolumesActionsTest-56686579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.962s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:10 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-63ab11b0-d6a5-45ff-b535-d8eec7e4189d tempest-VolumesActionsTest-56686579 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:05:10 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-63ab11b0-d6a5-45ff-b535-d8eec7e4189d tempest-VolumesActionsTest-56686579 None] Deleted volume successfully. Jul 07 22:05:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-63ab11b0-d6a5-45ff-b535-d8eec7e4189d tempest-VolumesActionsTest-56686579 None] Lock "cinder-13d65250-1cfe-44b6-9e90-a2b75a72effe-delete_volume" released by "delete_volume" :: held 3.228s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:05:11 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_l6l124vu" returned: 1 in 1.172s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_l6l124vu' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:05:11 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3ec9e1-078a-400f-aef1-a7f9ef5bd18a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_cf9d08ysdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:11 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_cf9d08ysdevstack@QuobyteHD Jul 07 22:05:11 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-18488d0b-35d9-4276-8e5c-a35a2ee526f6 req-a997e434-2338-41ce-9f27-1fcebb48d3a1 tempest-TestServerVolumeAttachmentScenario-1005538216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-18488d0b-35d9-4276-8e5c-a35a2ee526f6 req-a997e434-2338-41ce-9f27-1fcebb48d3a1 tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:12 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d943572-6084-47b3-89a4-02d8530c51c1]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-18488d0b-35d9-4276-8e5c-a35a2ee526f6 req-a997e434-2338-41ce-9f27-1fcebb48d3a1 tempest-TestServerVolumeAttachmentScenario-1005538216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-32b7bc4b-6335-4650-a7fa-46edac0b6155 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:12 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_cf9d08ysdevstack@QuobyteHD" returned: 0 in 0.885s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:12 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] 3ab6a905-2c25-4ca7-8034-1de3dbd6512d was qcow2, converting to raw {{(pid=87586) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:05:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_cf9d08ysdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:12 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-32b7bc4b-6335-4650-a7fa-46edac0b6155 Jul 07 22:05:12 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:12 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_cf9d08ysdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929 Jul 07 22:05:12 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:13 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-18488d0b-35d9-4276-8e5c-a35a2ee526f6 req-a997e434-2338-41ce-9f27-1fcebb48d3a1 tempest-TestServerVolumeAttachmentScenario-1005538216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-32b7bc4b-6335-4650-a7fa-46edac0b6155" returned: 0 in 1.159s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-18488d0b-35d9-4276-8e5c-a35a2ee526f6 req-a997e434-2338-41ce-9f27-1fcebb48d3a1 tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.201s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-18488d0b-35d9-4276-8e5c-a35a2ee526f6 req-a997e434-2338-41ce-9f27-1fcebb48d3a1 tempest-TestServerVolumeAttachmentScenario-1005538216 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491', 'name': 'volume-32b7bc4b-6335-4650-a7fa-46edac0b6155', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b633f2b-f054-45d9-bdef-63021c1a30a4', 'enforce_multipath': True} {{(pid=87586) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4930}} Jul 07 22:05:13 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-18488d0b-35d9-4276-8e5c-a35a2ee526f6 req-a997e434-2338-41ce-9f27-1fcebb48d3a1 tempest-TestServerVolumeAttachmentScenario-1005538216 None] attachment_update completed successfully. Jul 07 22:05:14 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_cf9d08ysdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929" returned: 0 in 2.619s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:14 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_cf9d08ysdevstack@QuobyteHD, size 112.00 MB, duration 2.62 sec, destination /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929 {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:05:14 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Converted 112.00 MB image at 42.75 MB/s Jul 07 22:05:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:14 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929 1G Jul 07 22:05:14 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:15 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929 1G" returned: 0 in 0.820s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:15 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[097f9ecb-3ca3-43ab-905b-6e01632e3a01]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:15 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929 Jul 07 22:05:15 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:16 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929" returned: 0 in 0.827s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:16 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929 Jul 07 22:05:16 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:17 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929" returned: 1 in 0.864s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:05:17 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Downloaded image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d ((None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}])) to volume bf5d4201-53d6-49ea-a7c8-a951487ea929 successfully. {{(pid=87586) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:05:17 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Temporary image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d for user e7187d0881e84c4c8babd32a20babd53 is deleted. {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:05:17 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Marking volume bf5d4201-53d6-49ea-a7c8-a951487ea929 as bootable. {{(pid=87586) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:05:17 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Copying metadata from image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d to bf5d4201-53d6-49ea-a7c8-a951487ea929. {{(pid=87586) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:05:17 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Creating volume glance metadata for volume bf5d4201-53d6-49ea-a7c8-a951487ea929 backed by image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87586) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:05:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb5abdb-80e8-49ef-814f-83c37e9c0bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf5d4201-53d6-49ea-a7c8-a951487ea929', 'volume_size': 1, 'image_id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '922c2d549e794c9ebc74bddfbafcb8e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'created_at': datetime.datetime(2026, 7, 7, 19, 46, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 19, 46, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3cc0364-47f5-42ef-81d8-f9d865719c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:17 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Volume volume-bf5d4201-53d6-49ea-a7c8-a951487ea929 (bf5d4201-53d6-49ea-a7c8-a951487ea929): created successfully Jul 07 22:05:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3cc0364-47f5-42ef-81d8-f9d865719c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Flow 'volume_create_manager' (e84ccc72-7687-478a-a7e1-b16efbfcf622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:05:17 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-b2990b04-2fea-4ef5-8bd7-33481c97c973 tempest-VolumesGetTest-1443487843 None] Created volume successfully. Jul 07 22:05:19 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:05:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Flow 'volume_create_manager' (e0f10e00-6765-40dd-9e16-85f07c1084a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:05:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c32d2bc-ad55-49fd-82da-d60bd5588e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c32d2bc-ad55-49fd-82da-d60bd5588e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:05:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1793365359',display_name='tempest-VolumesGetTest-Volume-1116021444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b5cf5e-edae-4223-94da-e2b2118825ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4aea704e354c598490def644cd75a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:05:19Z,use_quota=True,user_id='e7187d0881e84c4c8babd32a20babd53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (227838f8-1373-4235-a462-4e646f8e1473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (227838f8-1373-4235-a462-4e646f8e1473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88920ab7-8a13-4f6d-bea2-6e0a634488fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88920ab7-8a13-4f6d-bea2-6e0a634488fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24b5cf5e-edae-4223-94da-e2b2118825ed', 'volume_name': 'volume-24b5cf5e-edae-4223-94da-e2b2118825ed', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29875dc1-f56a-4c80-b88d-d8b018bbd485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29875dc1-f56a-4c80-b88d-d8b018bbd485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f67a0b7-cd78-498b-aa79-60b32a1510c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:19 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Volume 24b5cf5e-edae-4223-94da-e2b2118825ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24b5cf5e-edae-4223-94da-e2b2118825ed', 'volume_size': 1} Jul 07 22:05:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:05:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1793365359',display_name='tempest-VolumesGetTest-Volume-1116021444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b5cf5e-edae-4223-94da-e2b2118825ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4aea704e354c598490def644cd75a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:05:19Z,use_quota=True,user_id='e7187d0881e84c4c8babd32a20babd53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:05:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Creating volume 24b5cf5e-edae-4223-94da-e2b2118825ed {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:05:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:05:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:05:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:05:19 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:05:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-24b5cf5e-edae-4223-94da-e2b2118825ed 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:19 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-24b5cf5e-edae-4223-94da-e2b2118825ed 1073741824 Jul 07 22:05:19 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:20 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-369b2c5d-64df-41e2-8e6d-1bb1138c02c6 req-c06287f1-0cbe-4c43-887a-40a2201d54bf tempest-TestServerVolumeAttachmentScenario-1005538216 None] Terminate volume connection completed successfully. Jul 07 22:05:20 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-369b2c5d-64df-41e2-8e6d-1bb1138c02c6 req-c06287f1-0cbe-4c43-887a-40a2201d54bf tempest-TestServerVolumeAttachmentScenario-1005538216 None] Deleting attachment 3b633f2b-f054-45d9-bdef-63021c1a30a4. {{(pid=87586) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 07 22:05:20 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-24b5cf5e-edae-4223-94da-e2b2118825ed 1073741824" returned: 0 in 0.996s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-24b5cf5e-edae-4223-94da-e2b2118825ed {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:20 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-24b5cf5e-edae-4223-94da-e2b2118825ed Jul 07 22:05:20 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:21 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-24b5cf5e-edae-4223-94da-e2b2118825ed" returned: 0 in 0.725s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:05:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f67a0b7-cd78-498b-aa79-60b32a1510c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24b5cf5e-edae-4223-94da-e2b2118825ed', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e9181b-7c27-4369-b9fe-e34aa1a8c929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:21 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Volume volume-24b5cf5e-edae-4223-94da-e2b2118825ed (24b5cf5e-edae-4223-94da-e2b2118825ed): created successfully Jul 07 22:05:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e9181b-7c27-4369-b9fe-e34aa1a8c929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Flow 'volume_create_manager' (e0f10e00-6765-40dd-9e16-85f07c1084a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:05:21 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6e906ffa-244a-4006-b144-678050142e5e tempest-VolumesGetTest-1443487843 None] Created volume successfully. Jul 07 22:05:21 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5947de34-37b9-460e-b53a-531746149b14 tempest-VolumesGetTest-1443487843 None] Acquiring lock "cinder-24b5cf5e-edae-4223-94da-e2b2118825ed-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:05:21 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5947de34-37b9-460e-b53a-531746149b14 tempest-VolumesGetTest-1443487843 None] Lock "cinder-24b5cf5e-edae-4223-94da-e2b2118825ed-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:05:21 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5947de34-37b9-460e-b53a-531746149b14 tempest-VolumesGetTest-1443487843 None] Acquiring lock "cinder-quobyte-24b5cf5e-edae-4223-94da-e2b2118825ed" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:05:21 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5947de34-37b9-460e-b53a-531746149b14 tempest-VolumesGetTest-1443487843 None] Lock "cinder-quobyte-24b5cf5e-edae-4223-94da-e2b2118825ed" acquired by "delete_volume" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:05:21 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5fcac1-4a24-438a-a371-85e4a23e685f]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5947de34-37b9-460e-b53a-531746149b14 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-24b5cf5e-edae-4223-94da-e2b2118825ed {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:21 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-24b5cf5e-edae-4223-94da-e2b2118825ed Jul 07 22:05:21 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:22 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5947de34-37b9-460e-b53a-531746149b14 tempest-VolumesGetTest-1443487843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-24b5cf5e-edae-4223-94da-e2b2118825ed" returned: 0 in 0.841s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5947de34-37b9-460e-b53a-531746149b14 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-24b5cf5e-edae-4223-94da-e2b2118825ed {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:22 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-24b5cf5e-edae-4223-94da-e2b2118825ed Jul 07 22:05:22 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Flow 'volume_create_manager' (a5bffb01-10b3-4fb8-864b-3f2a4bf24b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf633a1-9a49-479a-90eb-4da6e5303bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf633a1-9a49-479a-90eb-4da6e5303bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1398675114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48bc6d43-9378-4e90-8613-6007e5268a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c89676cc3db42aabc354da06fc97cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:05:23Z,use_quota=True,user_id='2d81debb9a4e40f281369b6e3883847c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4ca481-8498-45b4-a080-d8b32a49efcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4ca481-8498-45b4-a080-d8b32a49efcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1fee341-ce4f-4223-80ff-1f9b4c700411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG cinder.image.glance [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Creating Keystone auth plugin from conf {{(pid=87586) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:05:23 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5947de34-37b9-460e-b53a-531746149b14 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-24b5cf5e-edae-4223-94da-e2b2118825ed" returned: 0 in 0.800s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1fee341-ce4f-4223-80ff-1f9b4c700411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '48bc6d43-9378-4e90-8613-6007e5268a0d', 'volume_name': 'volume-48bc6d43-9378-4e90-8613-6007e5268a0d', 'volume_size': 1, 'image_id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '922c2d549e794c9ebc74bddfbafcb8e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'created_at': datetime.datetime(2026, 7, 7, 19, 46, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 19, 46, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91464f92-ff44-4921-81da-8e5a88e56f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91464f92-ff44-4921-81da-8e5a88e56f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2609633-a34b-4c26-ae70-84359f032b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:23 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Volume 48bc6d43-9378-4e90-8613-6007e5268a0d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-48bc6d43-9378-4e90-8613-6007e5268a0d', 'volume_size': 1, 'image_id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '922c2d549e794c9ebc74bddfbafcb8e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'created_at': datetime.datetime(2026, 7, 7, 19, 46, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 19, 46, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Trying to clone 48bc6d43-9378-4e90-8613-6007e5268a0d from image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d at location (None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}]). {{(pid=87586) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5947de34-37b9-460e-b53a-531746149b14 tempest-VolumesGetTest-1443487843 None] Lock "cinder-quobyte-24b5cf5e-edae-4223-94da-e2b2118825ed" released by "delete_volume" :: held 1.741s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-5947de34-37b9-460e-b53a-531746149b14 tempest-VolumesGetTest-1443487843 None] Created reservations ['2b8e42c9-bb3e-4b7c-873b-6c17689ea590', 'da11273b-8361-4040-a7ec-21f07943a662', '9047c745-8677-4f12-93f4-937e10ccf294', '654d1bab-d91d-42b1-92f6-edba08f1a9ad'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5947de34-37b9-460e-b53a-531746149b14 tempest-VolumesGetTest-1443487843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5947de34-37b9-460e-b53a-531746149b14 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5947de34-37b9-460e-b53a-531746149b14 tempest-VolumesGetTest-1443487843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5947de34-37b9-460e-b53a-531746149b14 tempest-VolumesGetTest-1443487843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5947de34-37b9-460e-b53a-531746149b14 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5947de34-37b9-460e-b53a-531746149b14 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:23 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:05:23 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_ygeg0wsbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:05:23 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Image download 20.69 MB at 20.69 MB/s Jul 07 22:05:23 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-d0189833-3eb4-441a-a57a-04e5662d8842 req-5e83cf16-05bb-4836-ae8f-04b557e81143 tempest-TestServerVolumeAttachmentScenario-1005538216 None] Terminate volume connection completed successfully. Jul 07 22:05:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-d0189833-3eb4-441a-a57a-04e5662d8842 req-5e83cf16-05bb-4836-ae8f-04b557e81143 tempest-TestServerVolumeAttachmentScenario-1005538216 None] Deleting attachment f33aad35-9288-4d86-bf99-0ba7c6c1adce. {{(pid=87586) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 07 22:05:24 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b148e6e-1575-441d-97c0-cf0954c0b0a4]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_ygeg0wsbdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] Acquiring lock "cinder-bf5d4201-53d6-49ea-a7c8-a951487ea929-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:05:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] Lock "cinder-bf5d4201-53d6-49ea-a7c8-a951487ea929-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:05:24 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_ygeg0wsbdevstack@QuobyteHD Jul 07 22:05:24 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] Acquiring lock "cinder-quobyte-bf5d4201-53d6-49ea-a7c8-a951487ea929" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:05:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] Lock "cinder-quobyte-bf5d4201-53d6-49ea-a7c8-a951487ea929" acquired by "delete_volume" :: waited 0.030s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:05:24 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fce63a-a77c-4979-87eb-c175fe23168d]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:24 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929 Jul 07 22:05:24 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:24 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5947de34-37b9-460e-b53a-531746149b14 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.026s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:24 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-5947de34-37b9-460e-b53a-531746149b14 tempest-VolumesGetTest-1443487843 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:05:24 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-5947de34-37b9-460e-b53a-531746149b14 tempest-VolumesGetTest-1443487843 None] Deleted volume successfully. Jul 07 22:05:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5947de34-37b9-460e-b53a-531746149b14 tempest-VolumesGetTest-1443487843 None] Lock "cinder-24b5cf5e-edae-4223-94da-e2b2118825ed-delete_volume" released by "delete_volume" :: held 3.068s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:05:25 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_ygeg0wsbdevstack@QuobyteHD" returned: 0 in 0.974s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:25 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Temporary image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d is fetched for user 2d81debb9a4e40f281369b6e3883847c. {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:05:25 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91e49fc-709a-4389-8053-6f25f1787f32]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_ygeg0wsbdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:25 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929" returned: 0 in 0.845s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:25 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_ygeg0wsbdevstack@QuobyteHD Jul 07 22:05:25 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:25 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929 Jul 07 22:05:25 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:26 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:26 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929" returned: 1 in 0.800s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_ygeg0wsbdevstack@QuobyteHD" returned: 0 in 0.915s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1398675114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48bc6d43-9378-4e90-8613-6007e5268a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c89676cc3db42aabc354da06fc97cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:05:23Z,use_quota=True,user_id='2d81debb9a4e40f281369b6e3883847c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Creating volume 48bc6d43-9378-4e90-8613-6007e5268a0d {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:05:26 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:26 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929 Jul 07 22:05:26 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:26 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d 1073741824 Jul 07 22:05:26 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:26 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bf5d4201-53d6-49ea-a7c8-a951487ea929" returned: 0 in 0.747s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] Lock "cinder-quobyte-bf5d4201-53d6-49ea-a7c8-a951487ea929" released by "delete_volume" :: held 2.510s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] Created reservations ['f4ab63b6-9883-4015-8a7a-56f69897ea37', 'b64a5649-8d6e-48e1-871d-06172d08345f', 'e57a7c63-0729-449a-8492-a74b9c58bcbe', 'fce008a5-ff92-4ed8-a080-1e39fb7ed46b'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:27 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:05:27 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:27 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d 1073741824" returned: 0 in 1.132s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:27 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d Jul 07 22:05:27 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:27 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:05:27 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Flow 'volume_create_manager' (eb653d3c-07b6-4c1d-8df7-3641c00d772f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:05:27 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57442d1f-121a-4370-bd00-255bd8e807ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:27 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57442d1f-121a-4370-bd00-255bd8e807ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-671311399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='967bf2601f6c4db7b1be5d9f66f7cdb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:05:27Z,use_quota=True,user_id='396b927742694de1803b3986a5021af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:27 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81b21a2-f2f2-4b7f-b5ce-3ab20986aaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:27 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81b21a2-f2f2-4b7f-b5ce-3ab20986aaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:27 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba633006-5837-416b-ac77-43ed76cd2f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:27 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba633006-5837-416b-ac77-43ed76cd2f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1', 'volume_name': 'volume-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:27 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772dba68-7683-4827-a2a6-fc633c51caec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:27 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772dba68-7683-4827-a2a6-fc633c51caec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:27 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5981f319-fda9-4b6f-8fa3-5891b27af7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:27 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Volume 9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1', 'volume_size': 1} Jul 07 22:05:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:28 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.261s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:28 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:05:28 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] Deleted volume successfully. Jul 07 22:05:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-915fe38d-0ba3-4e82-8262-5299c976f513 tempest-VolumesGetTest-1443487843 None] Lock "cinder-bf5d4201-53d6-49ea-a7c8-a951487ea929-delete_volume" released by "delete_volume" :: held 4.106s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:05:28 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d" returned: 0 in 1.180s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] <== create_volume: return (2358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:05:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.362s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.742s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-671311399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='967bf2601f6c4db7b1be5d9f66f7cdb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:05:27Z,use_quota=True,user_id='396b927742694de1803b3986a5021af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:05:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Creating volume 9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:05:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:05:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:05:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:05:28 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:05:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:28 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1 1073741824 Jul 07 22:05:28 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:28 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Attempting download of 3ab6a905-2c25-4ca7-8034-1de3dbd6512d ((None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}])) to volume 48bc6d43-9378-4e90-8613-6007e5268a0d. {{(pid=87586) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:05:28 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c6f213-66ff-4f71-9cf1-879cfa7facc6]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_lc_rw4uj {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:28 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_lc_rw4uj Jul 07 22:05:28 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_lc_rw4uj" returned: 0 in 1.018s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:29 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_lc_rw4uj {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:29 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_lc_rw4uj Jul 07 22:05:29 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:29 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1 1073741824" returned: 0 in 1.339s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:29 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1 Jul 07 22:05:29 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:30 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_lc_rw4uj" returned: 1 in 0.901s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_lc_rw4uj' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:05:30 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[46223d44-f977-4d4a-8d4a-49f0de141d3f]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_ygeg0wsbdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:30 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_ygeg0wsbdevstack@QuobyteHD Jul 07 22:05:30 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:30 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1" returned: 0 in 0.822s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] <== create_volume: return (2242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:05:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.246s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5981f319-fda9-4b6f-8fa3-5891b27af7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcdb06a4-d7a5-40b4-b802-c0378d7642d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:30 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Volume volume-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1 (9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1): created successfully Jul 07 22:05:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcdb06a4-d7a5-40b4-b802-c0378d7642d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Flow 'volume_create_manager' (eb653d3c-07b6-4c1d-8df7-3641c00d772f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:05:30 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6f27797c-c689-49f7-a8de-c2838316e572 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Created volume successfully. Jul 07 22:05:31 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_ygeg0wsbdevstack@QuobyteHD" returned: 0 in 0.795s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] 3ab6a905-2c25-4ca7-8034-1de3dbd6512d was qcow2, converting to raw {{(pid=87586) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_ygeg0wsbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:31 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_ygeg0wsbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d Jul 07 22:05:31 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Flow 'volume_create_manager' (dfb29747-00c6-46d2-b023-c21a4c1ced3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4168b39d-046f-4d64-92fb-54d6de93ddb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4168b39d-046f-4d64-92fb-54d6de93ddb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1821851071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=939ed19e-382b-4c34-8b3f-ae1a3e57936c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b4c68670c549b5992351734aba8bb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:05:32Z,use_quota=True,user_id='d90450de256d4a07b6064e07bf70a572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e4b1ab-5821-48bb-bcbc-2137e41090e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e4b1ab-5821-48bb-bcbc-2137e41090e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed07943b-8e0b-483a-adc8-514372b42b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed07943b-8e0b-483a-adc8-514372b42b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '939ed19e-382b-4c34-8b3f-ae1a3e57936c', 'volume_name': 'volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1438900e-5560-41a0-b1a2-5916b52444da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1438900e-5560-41a0-b1a2-5916b52444da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a94a9ce-6990-4f1b-8d00-ac18ca11811a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:31 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Volume 939ed19e-382b-4c34-8b3f-ae1a3e57936c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c', 'volume_size': 1} Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1821851071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=939ed19e-382b-4c34-8b3f-ae1a3e57936c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b4c68670c549b5992351734aba8bb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:05:32Z,use_quota=True,user_id='d90450de256d4a07b6064e07bf70a572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Creating volume 939ed19e-382b-4c34-8b3f-ae1a3e57936c {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:05:31 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:05:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:31 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c 1073741824 Jul 07 22:05:31 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:32 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c 1073741824" returned: 0 in 0.996s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:32 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c Jul 07 22:05:32 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:33 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_ygeg0wsbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d" returned: 0 in 2.237s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:33 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_ygeg0wsbdevstack@QuobyteHD, size 112.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:05:33 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Converted 112.00 MB image at 50.05 MB/s Jul 07 22:05:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:33 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d 1G Jul 07 22:05:33 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:33 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c" returned: 0 in 0.686s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:33 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:05:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a94a9ce-6990-4f1b-8d00-ac18ca11811a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b36a32-61c0-48e7-918b-9373403f2595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:33 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Volume volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c (939ed19e-382b-4c34-8b3f-ae1a3e57936c): created successfully Jul 07 22:05:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b36a32-61c0-48e7-918b-9373403f2595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Flow 'volume_create_manager' (dfb29747-00c6-46d2-b023-c21a4c1ced3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:05:33 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ec357f07-8d92-4c6e-951b-ff553909dcfd tempest-VolumesSnapshotListTestJSON-112825714 None] Created volume successfully. Jul 07 22:05:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b177e5b8-7e75-4341-aea3-bce3bb678856 tempest-VolumesSnapshotListTestJSON-112825714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b177e5b8-7e75-4341-aea3-bce3bb678856 tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:33 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-b177e5b8-7e75-4341-aea3-bce3bb678856 tempest-VolumesSnapshotListTestJSON-112825714 None] Creating offline snapshot bbf9a156-f3e6-4395-b69c-22a727b254ca of volume 939ed19e-382b-4c34-8b3f-ae1a3e57936c {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:05:34 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[616047c4-08ca-4c86-ab5a-c940e9125cfa]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b177e5b8-7e75-4341-aea3-bce3bb678856 tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:34 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c Jul 07 22:05:34 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:34 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d 1G" returned: 0 in 0.742s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:34 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bc0eec-16fb-419e-b7aa-b4bccc0147f5]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:34 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d Jul 07 22:05:34 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:34 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b177e5b8-7e75-4341-aea3-bce3bb678856 tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c" returned: 0 in 0.977s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b177e5b8-7e75-4341-aea3-bce3bb678856 tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:35 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca 1G Jul 07 22:05:35 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-0c4985a5-73a8-4a68-9f82-c5ce69fcb9b7 req-dad4ee65-f621-4c0e-9e91-5fc5b3cb0547 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:35 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d" returned: 0 in 0.873s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:35 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d Jul 07 22:05:35 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:05:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:05:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:05:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:35 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:05:35 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-31934bbc-b82b-4a60-86bb-3615d7d4579b tempest-TestServerVolumeAttachmentScenario-1005538216 None] Acquiring lock "cinder-32b7bc4b-6335-4650-a7fa-46edac0b6155-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:05:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-31934bbc-b82b-4a60-86bb-3615d7d4579b tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "cinder-32b7bc4b-6335-4650-a7fa-46edac0b6155-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:05:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-31934bbc-b82b-4a60-86bb-3615d7d4579b tempest-TestServerVolumeAttachmentScenario-1005538216 None] Acquiring lock "cinder-quobyte-32b7bc4b-6335-4650-a7fa-46edac0b6155" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:05:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-31934bbc-b82b-4a60-86bb-3615d7d4579b tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "cinder-quobyte-32b7bc4b-6335-4650-a7fa-46edac0b6155" acquired by "delete_volume" :: waited 0.041s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:05:35 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64659d5-21ae-4a03-aaeb-1cb15f8f7a18]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-31934bbc-b82b-4a60-86bb-3615d7d4579b tempest-TestServerVolumeAttachmentScenario-1005538216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-32b7bc4b-6335-4650-a7fa-46edac0b6155 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:35 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-32b7bc4b-6335-4650-a7fa-46edac0b6155 Jul 07 22:05:35 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:36 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b177e5b8-7e75-4341-aea3-bce3bb678856 tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca 1G" returned: 0 in 1.073s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b177e5b8-7e75-4341-aea3-bce3bb678856 tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:36 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca Jul 07 22:05:36 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:36 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d" returned: 1 in 0.998s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:05:36 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Downloaded image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d ((None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}])) to volume 48bc6d43-9378-4e90-8613-6007e5268a0d successfully. {{(pid=87586) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:05:36 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Temporary image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d for user 2d81debb9a4e40f281369b6e3883847c is deleted. {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:05:36 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Marking volume 48bc6d43-9378-4e90-8613-6007e5268a0d as bootable. {{(pid=87586) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:05:36 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Copying metadata from image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d to 48bc6d43-9378-4e90-8613-6007e5268a0d. {{(pid=87586) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:05:36 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Creating volume glance metadata for volume 48bc6d43-9378-4e90-8613-6007e5268a0d backed by image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87586) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:05:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2609633-a34b-4c26-ae70-84359f032b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48bc6d43-9378-4e90-8613-6007e5268a0d', 'volume_size': 1, 'image_id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '922c2d549e794c9ebc74bddfbafcb8e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'created_at': datetime.datetime(2026, 7, 7, 19, 46, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 19, 46, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca422a99-2a56-46c5-980a-e6b4e6c94a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:36 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Volume volume-48bc6d43-9378-4e90-8613-6007e5268a0d (48bc6d43-9378-4e90-8613-6007e5268a0d): created successfully Jul 07 22:05:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca422a99-2a56-46c5-980a-e6b4e6c94a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Flow 'volume_create_manager' (a5bffb01-10b3-4fb8-864b-3f2a4bf24b8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:05:36 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-bbdb3edd-5bb2-4888-87c2-0cde1b128f11 tempest-VolumesImageMetadata-1708883864 None] Created volume successfully. Jul 07 22:05:36 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.941s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:05:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:05:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 28 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 22:05:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 22:05:36 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-31934bbc-b82b-4a60-86bb-3615d7d4579b tempest-TestServerVolumeAttachmentScenario-1005538216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-32b7bc4b-6335-4650-a7fa-46edac0b6155" returned: 0 in 0.902s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-31934bbc-b82b-4a60-86bb-3615d7d4579b tempest-TestServerVolumeAttachmentScenario-1005538216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-32b7bc4b-6335-4650-a7fa-46edac0b6155 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:36 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-32b7bc4b-6335-4650-a7fa-46edac0b6155 Jul 07 22:05:36 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:36 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b177e5b8-7e75-4341-aea3-bce3bb678856 tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca" returned: 0 in 0.879s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:36 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-b177e5b8-7e75-4341-aea3-bce3bb678856 tempest-VolumesSnapshotListTestJSON-112825714 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca is being set with open permissions: ugo+rw Jul 07 22:05:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b177e5b8-7e75-4341-aea3-bce3bb678856 tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:36 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca Jul 07 22:05:36 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:37 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-31934bbc-b82b-4a60-86bb-3615d7d4579b tempest-TestServerVolumeAttachmentScenario-1005538216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-32b7bc4b-6335-4650-a7fa-46edac0b6155" returned: 0 in 0.682s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-31934bbc-b82b-4a60-86bb-3615d7d4579b tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "cinder-quobyte-32b7bc4b-6335-4650-a7fa-46edac0b6155" released by "delete_volume" :: held 1.635s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:05:37 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-31934bbc-b82b-4a60-86bb-3615d7d4579b tempest-TestServerVolumeAttachmentScenario-1005538216 None] Created reservations ['db2ce449-72aa-4131-8344-4e8a497dea39', 'd96eae81-f38b-4499-ba7c-434f439a733e', 'b9aa4478-3461-4d6a-a74d-18d2c3009b57', 'd172cb11-6833-4c40-b4aa-66161e116432'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:05:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-31934bbc-b82b-4a60-86bb-3615d7d4579b tempest-TestServerVolumeAttachmentScenario-1005538216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-31934bbc-b82b-4a60-86bb-3615d7d4579b tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-31934bbc-b82b-4a60-86bb-3615d7d4579b tempest-TestServerVolumeAttachmentScenario-1005538216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:05:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-31934bbc-b82b-4a60-86bb-3615d7d4579b tempest-TestServerVolumeAttachmentScenario-1005538216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:05:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-31934bbc-b82b-4a60-86bb-3615d7d4579b tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-31934bbc-b82b-4a60-86bb-3615d7d4579b tempest-TestServerVolumeAttachmentScenario-1005538216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:37 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:05:37 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:37 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b177e5b8-7e75-4341-aea3-bce3bb678856 tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca" returned: 0 in 0.706s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b177e5b8-7e75-4341-aea3-bce3bb678856 tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:37 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.info Jul 07 22:05:37 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] Acquiring lock "cinder-48bc6d43-9378-4e90-8613-6007e5268a0d-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:05:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] Lock "cinder-48bc6d43-9378-4e90-8613-6007e5268a0d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:05:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] Acquiring lock "cinder-quobyte-48bc6d43-9378-4e90-8613-6007e5268a0d" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:05:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f1a77870-116b-46a2-99b7-c8ecf363052a tempest-TestServerVolumeAttachmentScenario-1005538216 None] Acquiring lock "cinder-4758e8c2-8235-46e1-8bea-2730b056e6b1-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:05:38 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] Lock "cinder-quobyte-48bc6d43-9378-4e90-8613-6007e5268a0d" acquired by "delete_volume" :: waited 0.065s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:05:38 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f1a77870-116b-46a2-99b7-c8ecf363052a tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "cinder-4758e8c2-8235-46e1-8bea-2730b056e6b1-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:05:38 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[42025a0d-d4fb-434a-a0cd-40545443d834]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:38 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f1a77870-116b-46a2-99b7-c8ecf363052a tempest-TestServerVolumeAttachmentScenario-1005538216 None] Acquiring lock "cinder-quobyte-4758e8c2-8235-46e1-8bea-2730b056e6b1" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:05:38 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f1a77870-116b-46a2-99b7-c8ecf363052a tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "cinder-quobyte-4758e8c2-8235-46e1-8bea-2730b056e6b1" acquired by "delete_volume" :: waited 0.030s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:05:38 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4043baee-79ac-47c1-bc71-c4e189a90076]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1a77870-116b-46a2-99b7-c8ecf363052a tempest-TestServerVolumeAttachmentScenario-1005538216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4758e8c2-8235-46e1-8bea-2730b056e6b1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:38 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d Jul 07 22:05:38 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:38 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4758e8c2-8235-46e1-8bea-2730b056e6b1 Jul 07 22:05:38 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:38 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-31934bbc-b82b-4a60-86bb-3615d7d4579b tempest-TestServerVolumeAttachmentScenario-1005538216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.784s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:38 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-31934bbc-b82b-4a60-86bb-3615d7d4579b tempest-TestServerVolumeAttachmentScenario-1005538216 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:05:38 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-31934bbc-b82b-4a60-86bb-3615d7d4579b tempest-TestServerVolumeAttachmentScenario-1005538216 None] Deleted volume successfully. Jul 07 22:05:38 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-31934bbc-b82b-4a60-86bb-3615d7d4579b tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "cinder-32b7bc4b-6335-4650-a7fa-46edac0b6155-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:05:38 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b177e5b8-7e75-4341-aea3-bce3bb678856 tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.info" returned: 0 in 0.801s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:38 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-b177e5b8-7e75-4341-aea3-bce3bb678856 tempest-VolumesSnapshotListTestJSON-112825714 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.info is being set with open permissions: ugo+rw Jul 07 22:05:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b177e5b8-7e75-4341-aea3-bce3bb678856 tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:38 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.info Jul 07 22:05:38 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:38 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d" returned: 0 in 0.864s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:39 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1a77870-116b-46a2-99b7-c8ecf363052a tempest-TestServerVolumeAttachmentScenario-1005538216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4758e8c2-8235-46e1-8bea-2730b056e6b1" returned: 0 in 0.856s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1a77870-116b-46a2-99b7-c8ecf363052a tempest-TestServerVolumeAttachmentScenario-1005538216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4758e8c2-8235-46e1-8bea-2730b056e6b1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:39 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d Jul 07 22:05:39 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:39 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4758e8c2-8235-46e1-8bea-2730b056e6b1 Jul 07 22:05:39 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:39 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b177e5b8-7e75-4341-aea3-bce3bb678856 tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.info" returned: 0 in 0.719s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b177e5b8-7e75-4341-aea3-bce3bb678856 tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.271s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-0c4985a5-73a8-4a68-9f82-c5ce69fcb9b7 req-dad4ee65-f621-4c0e-9e91-5fc5b3cb0547 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.151s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:39 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25f7de2-6cfa-46da-8005-2548a8d8249a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-0c4985a5-73a8-4a68-9f82-c5ce69fcb9b7 req-dad4ee65-f621-4c0e-9e91-5fc5b3cb0547 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:39 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-b177e5b8-7e75-4341-aea3-bce3bb678856 tempest-VolumesSnapshotListTestJSON-112825714 None] Create snapshot completed successfully Jul 07 22:05:39 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1 Jul 07 22:05:39 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:39 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d" returned: 1 in 0.815s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:05:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:39 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1a77870-116b-46a2-99b7-c8ecf363052a tempest-TestServerVolumeAttachmentScenario-1005538216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4758e8c2-8235-46e1-8bea-2730b056e6b1" returned: 0 in 0.734s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:39 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d Jul 07 22:05:39 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f1a77870-116b-46a2-99b7-c8ecf363052a tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "cinder-quobyte-4758e8c2-8235-46e1-8bea-2730b056e6b1" released by "delete_volume" :: held 1.671s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:05:39 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-f1a77870-116b-46a2-99b7-c8ecf363052a tempest-TestServerVolumeAttachmentScenario-1005538216 None] Created reservations ['bd031967-1d72-4b33-be8c-8ad201fc03b5', '90eb94bd-1efa-4366-b93d-5fe801a0b4a4', 'd28b3106-c32e-4b86-879f-858aea67efb4', '0b7e59a5-ff48-4700-a593-94446783b2a5'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:05:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f1a77870-116b-46a2-99b7-c8ecf363052a tempest-TestServerVolumeAttachmentScenario-1005538216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f1a77870-116b-46a2-99b7-c8ecf363052a tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:39 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f1a77870-116b-46a2-99b7-c8ecf363052a tempest-TestServerVolumeAttachmentScenario-1005538216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:05:39 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f1a77870-116b-46a2-99b7-c8ecf363052a tempest-TestServerVolumeAttachmentScenario-1005538216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:05:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f1a77870-116b-46a2-99b7-c8ecf363052a tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1a77870-116b-46a2-99b7-c8ecf363052a tempest-TestServerVolumeAttachmentScenario-1005538216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:39 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:05:39 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:40 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-0c4985a5-73a8-4a68-9f82-c5ce69fcb9b7 req-dad4ee65-f621-4c0e-9e91-5fc5b3cb0547 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1" returned: 0 in 0.787s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-0c4985a5-73a8-4a68-9f82-c5ce69fcb9b7 req-dad4ee65-f621-4c0e-9e91-5fc5b3cb0547 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.823s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-0c4985a5-73a8-4a68-9f82-c5ce69fcb9b7 req-dad4ee65-f621-4c0e-9e91-5fc5b3cb0547 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491', 'name': 'volume-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0105c9e-d271-4c96-a109-80a9384b949b', 'enforce_multipath': True} {{(pid=87586) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4930}} Jul 07 22:05:40 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-0c4985a5-73a8-4a68-9f82-c5ce69fcb9b7 req-dad4ee65-f621-4c0e-9e91-5fc5b3cb0547 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] attachment_update completed successfully. Jul 07 22:05:40 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48bc6d43-9378-4e90-8613-6007e5268a0d" returned: 0 in 0.754s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] Lock "cinder-quobyte-48bc6d43-9378-4e90-8613-6007e5268a0d" released by "delete_volume" :: held 2.555s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:05:40 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] Created reservations ['2e6392e2-1b1c-45ec-9079-efe588429225', '3d76e416-f65c-4959-b659-f93736ac27c9', '8e28a0b0-f261-448e-b976-8ff271ca233b', '96f00210-c7a4-4812-baa3-63c8345e012b'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:05:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0a2b856f-2b35-47fd-9479-efd2e0265b4b tempest-VolumesSnapshotListTestJSON-112825714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0a2b856f-2b35-47fd-9479-efd2e0265b4b tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:40 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-0a2b856f-2b35-47fd-9479-efd2e0265b4b tempest-VolumesSnapshotListTestJSON-112825714 None] Creating offline snapshot bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 of volume 939ed19e-382b-4c34-8b3f-ae1a3e57936c {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:05:40 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e884c5-f2fc-4bd7-8c17-11b031e41ba5]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0a2b856f-2b35-47fd-9479-efd2e0265b4b tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:40 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1a77870-116b-46a2-99b7-c8ecf363052a tempest-TestServerVolumeAttachmentScenario-1005538216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.898s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:40 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-f1a77870-116b-46a2-99b7-c8ecf363052a tempest-TestServerVolumeAttachmentScenario-1005538216 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:05:40 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-f1a77870-116b-46a2-99b7-c8ecf363052a tempest-TestServerVolumeAttachmentScenario-1005538216 None] Deleted volume successfully. Jul 07 22:05:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f1a77870-116b-46a2-99b7-c8ecf363052a tempest-TestServerVolumeAttachmentScenario-1005538216 None] Lock "cinder-4758e8c2-8235-46e1-8bea-2730b056e6b1-delete_volume" released by "delete_volume" :: held 2.863s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:05:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:40 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:05:40 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:05:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:40 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca Jul 07 22:05:40 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:40 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:05:40 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:41 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0a2b856f-2b35-47fd-9479-efd2e0265b4b tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca" returned: 0 in 1.148s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-0a2b856f-2b35-47fd-9479-efd2e0265b4b tempest-VolumesSnapshotListTestJSON-112825714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:05:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0a2b856f-2b35-47fd-9479-efd2e0265b4b tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:41 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.013s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:41 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:05:41 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] Deleted volume successfully. Jul 07 22:05:41 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 1G Jul 07 22:05:41 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:41 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-dfcb6c53-56ea-4fdd-a047-822e3086ad86 tempest-VolumesImageMetadata-1708883864 None] Lock "cinder-48bc6d43-9378-4e90-8613-6007e5268a0d-delete_volume" released by "delete_volume" :: held 4.092s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:05:43 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0a2b856f-2b35-47fd-9479-efd2e0265b4b tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 1G" returned: 0 in 1.124s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0a2b856f-2b35-47fd-9479-efd2e0265b4b tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:43 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 Jul 07 22:05:43 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:43 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0a2b856f-2b35-47fd-9479-efd2e0265b4b tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52" returned: 0 in 0.955s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:44 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-0a2b856f-2b35-47fd-9479-efd2e0265b4b tempest-VolumesSnapshotListTestJSON-112825714 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 is being set with open permissions: ugo+rw Jul 07 22:05:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0a2b856f-2b35-47fd-9479-efd2e0265b4b tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:44 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 Jul 07 22:05:44 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:44 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0a2b856f-2b35-47fd-9479-efd2e0265b4b tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52" returned: 0 in 0.818s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0a2b856f-2b35-47fd-9479-efd2e0265b4b tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.223s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:44 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-0a2b856f-2b35-47fd-9479-efd2e0265b4b tempest-VolumesSnapshotListTestJSON-112825714 None] Create snapshot completed successfully Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Flow 'volume_create_manager' (e259eadb-a92a-4bc2-90ea-827f3ecda1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e496f56-430c-45cc-9151-917b095826e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:UPDATE=126,cinder:INSERT=39,cinder:DELETE=11,cinder:SELECT=120 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e496f56-430c-45cc-9151-917b095826e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1063147330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04506795-ee66-424f-8cf3-ba7ba4907ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9995a60a289e42c48ab36dd46d53a58a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:05:45Z,use_quota=True,user_id='aa615c6c3954468e93d5a33d2e68c964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfdef31e-df3d-4b93-9224-07181d77a5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfdef31e-df3d-4b93-9224-07181d77a5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ed5b57-b0e5-4e45-96a4-2319aae20341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ed5b57-b0e5-4e45-96a4-2319aae20341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04506795-ee66-424f-8cf3-ba7ba4907ce7', 'volume_name': 'volume-04506795-ee66-424f-8cf3-ba7ba4907ce7', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009ef40f-5d0b-4b1b-b216-5b09689c52c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009ef40f-5d0b-4b1b-b216-5b09689c52c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ba40d8-ed9c-4a6d-833f-3d43dfb00309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:45 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Volume 04506795-ee66-424f-8cf3-ba7ba4907ce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04506795-ee66-424f-8cf3-ba7ba4907ce7', 'volume_size': 1} Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1063147330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04506795-ee66-424f-8cf3-ba7ba4907ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9995a60a289e42c48ab36dd46d53a58a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:05:45Z,use_quota=True,user_id='aa615c6c3954468e93d5a33d2e68c964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Creating volume 04506795-ee66-424f-8cf3-ba7ba4907ce7 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:05:45 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:05:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:45 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 1073741824 Jul 07 22:05:45 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:46 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:UPDATE=133,cinder:SELECT=108,cinder:DELETE=12,cinder:INSERT=42 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:05:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f2c78575-e9dc-45d9-abf8-80e915a4727b tempest-VolumesSnapshotListTestJSON-112825714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:46 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 1073741824" returned: 0 in 1.063s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:46 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 Jul 07 22:05:46 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:47 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-0477623a-b290-4757-9f17-92c5f8b3b9d6 req-46349282-81f0-47b2-bd83-881103be9609 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Terminate volume connection completed successfully. Jul 07 22:05:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-0477623a-b290-4757-9f17-92c5f8b3b9d6 req-46349282-81f0-47b2-bd83-881103be9609 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Deleting attachment e0105c9e-d271-4c96-a109-80a9384b949b. {{(pid=87586) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 07 22:05:47 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7" returned: 0 in 0.821s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:47 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] <== create_volume: return (1927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:05:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.929s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f2c78575-e9dc-45d9-abf8-80e915a4727b tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.348s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:47 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-f2c78575-e9dc-45d9-abf8-80e915a4727b tempest-VolumesSnapshotListTestJSON-112825714 None] Creating offline snapshot 615fe9a4-de34-4526-a7b7-d3587330a562 of volume 939ed19e-382b-4c34-8b3f-ae1a3e57936c {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:05:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ba40d8-ed9c-4a6d-833f-3d43dfb00309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04506795-ee66-424f-8cf3-ba7ba4907ce7', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78fb81a2-0b9a-4003-9186-0f7db1ec2eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:47 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[056389f4-95d2-45c3-9dc7-982e917f3b61]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f2c78575-e9dc-45d9-abf8-80e915a4727b tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:47 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Volume volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 (04506795-ee66-424f-8cf3-ba7ba4907ce7): created successfully Jul 07 22:05:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78fb81a2-0b9a-4003-9186-0f7db1ec2eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Flow 'volume_create_manager' (e259eadb-a92a-4bc2-90ea-827f3ecda1cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:05:47 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ff0535ff-6d9b-45ca-8a59-f88c19f386bd tempest-VolumesCloneTest-1160812802 None] Created volume successfully. Jul 07 22:05:47 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 Jul 07 22:05:47 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:48 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f2c78575-e9dc-45d9-abf8-80e915a4727b tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52" returned: 0 in 0.816s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:48 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-f2c78575-e9dc-45d9-abf8-80e915a4727b tempest-VolumesSnapshotListTestJSON-112825714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:05:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f2c78575-e9dc-45d9-abf8-80e915a4727b tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.615fe9a4-de34-4526-a7b7-d3587330a562 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:48 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.615fe9a4-de34-4526-a7b7-d3587330a562 1G Jul 07 22:05:48 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:49 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:05:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Flow 'volume_create_manager' (fb326254-9dcd-45fa-b666-93eb32e878ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:05:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (220e7a2a-d83c-44de-b07f-39b1f9f8e430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (220e7a2a-d83c-44de-b07f-39b1f9f8e430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1484815111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8170b80d-a9fd-4f40-a726-0796587cec7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9995a60a289e42c48ab36dd46d53a58a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:05:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=04506795-ee66-424f-8cf3-ba7ba4907ce7,status='creating',terminated_at=None,updated_at=2026-07-07T20:05:49Z,use_quota=True,user_id='aa615c6c3954468e93d5a33d2e68c964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a87234-2a08-4fdf-b4a4-5072704b2ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a87234-2a08-4fdf-b4a4-5072704b2ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9125ffc-b144-475e-8fbf-ff6ee2d05e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9125ffc-b144-475e-8fbf-ff6ee2d05e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8170b80d-a9fd-4f40-a726-0796587cec7f', 'volume_name': 'volume-8170b80d-a9fd-4f40-a726-0796587cec7f', 'volume_size': 2, 'source_volid': '04506795-ee66-424f-8cf3-ba7ba4907ce7', 'source_volstatus': 'available'}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224e62e1-9b46-484a-ba7b-f565de237f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224e62e1-9b46-484a-ba7b-f565de237f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ceefb93-fee1-4d29-bae6-8ca505a5c7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:49 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Volume 8170b80d-a9fd-4f40-a726-0796587cec7f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8170b80d-a9fd-4f40-a726-0796587cec7f', 'volume_size': 2, 'source_volid': '04506795-ee66-424f-8cf3-ba7ba4907ce7', 'source_volstatus': 'available'} Jul 07 22:05:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:49 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-dabbd1c6-f882-415c-9dce-b3db2ebd85e1 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Acquiring lock "cinder-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:05:49 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-dabbd1c6-f882-415c-9dce-b3db2ebd85e1 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Lock "cinder-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:05:49 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-dabbd1c6-f882-415c-9dce-b3db2ebd85e1 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Acquiring lock "cinder-quobyte-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:05:49 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-dabbd1c6-f882-415c-9dce-b3db2ebd85e1 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Lock "cinder-quobyte-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1" acquired by "delete_volume" :: waited 0.023s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:05:49 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf2051d-fa38-4ca5-aa24-b40189e45fa1]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dabbd1c6-f882-415c-9dce-b3db2ebd85e1 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:49 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f2c78575-e9dc-45d9-abf8-80e915a4727b tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.615fe9a4-de34-4526-a7b7-d3587330a562 1G" returned: 0 in 1.230s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f2c78575-e9dc-45d9-abf8-80e915a4727b tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.615fe9a4-de34-4526-a7b7-d3587330a562 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:49 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.615fe9a4-de34-4526-a7b7-d3587330a562 Jul 07 22:05:49 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:49 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1 Jul 07 22:05:49 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:50 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dabbd1c6-f882-415c-9dce-b3db2ebd85e1 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1" returned: 0 in 0.784s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dabbd1c6-f882-415c-9dce-b3db2ebd85e1 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:50 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1 Jul 07 22:05:50 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:50 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f2c78575-e9dc-45d9-abf8-80e915a4727b tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.615fe9a4-de34-4526-a7b7-d3587330a562" returned: 0 in 0.822s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:50 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-f2c78575-e9dc-45d9-abf8-80e915a4727b tempest-VolumesSnapshotListTestJSON-112825714 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.615fe9a4-de34-4526-a7b7-d3587330a562 is being set with open permissions: ugo+rw Jul 07 22:05:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f2c78575-e9dc-45d9-abf8-80e915a4727b tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.615fe9a4-de34-4526-a7b7-d3587330a562 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:50 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.615fe9a4-de34-4526-a7b7-d3587330a562 Jul 07 22:05:50 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:51 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dabbd1c6-f882-415c-9dce-b3db2ebd85e1 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1" returned: 0 in 0.716s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-dabbd1c6-f882-415c-9dce-b3db2ebd85e1 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Lock "cinder-quobyte-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1" released by "delete_volume" :: held 1.557s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:05:51 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f2c78575-e9dc-45d9-abf8-80e915a4727b tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.615fe9a4-de34-4526-a7b7-d3587330a562" returned: 0 in 0.705s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f2c78575-e9dc-45d9-abf8-80e915a4727b tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.704s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.754s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:51 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Cloning volume 04506795-ee66-424f-8cf3-ba7ba4907ce7 to volume 8170b80d-a9fd-4f40-a726-0796587cec7f Jul 07 22:05:51 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-f2c78575-e9dc-45d9-abf8-80e915a4727b tempest-VolumesSnapshotListTestJSON-112825714 None] Create snapshot completed successfully Jul 07 22:05:51 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-dabbd1c6-f882-415c-9dce-b3db2ebd85e1 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Created reservations ['7dd96938-a4df-44d8-8345-e5102363bf9f', '057dd345-97e9-4842-a3cd-1507d4c83a35', 'c5d2bfda-38ff-416d-8a60-818db2e3f22b', '2123c841-03b2-41ce-b3ea-da4a56aa5f0c'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:05:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Creating offline snapshot 8bd051cd-e15e-4658-83a5-a6d7b3bed83b of volume 04506795-ee66-424f-8cf3-ba7ba4907ce7 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:05:51 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d45162-65af-4d3f-b01e-13ce7b84ddc4]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dabbd1c6-f882-415c-9dce-b3db2ebd85e1 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dabbd1c6-f882-415c-9dce-b3db2ebd85e1 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dabbd1c6-f882-415c-9dce-b3db2ebd85e1 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:05:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dabbd1c6-f882-415c-9dce-b3db2ebd85e1 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:05:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dabbd1c6-f882-415c-9dce-b3db2ebd85e1 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dabbd1c6-f882-415c-9dce-b3db2ebd85e1 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:51 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:05:51 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:51 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 Jul 07 22:05:51 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:52 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dabbd1c6-f882-415c-9dce-b3db2ebd85e1 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.903s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:52 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-dabbd1c6-f882-415c-9dce-b3db2ebd85e1 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:05:52 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-dabbd1c6-f882-415c-9dce-b3db2ebd85e1 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Deleted volume successfully. Jul 07 22:05:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-dabbd1c6-f882-415c-9dce-b3db2ebd85e1 tempest-TestServerVolumeAttachScenarioOldVersion-1493206642 None] Lock "cinder-9bfa3a5e-a6f2-4c6d-ae31-2e8a0e234dd1-delete_volume" released by "delete_volume" :: held 2.918s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:05:52 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7" returned: 0 in 1.079s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:52 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b 1G Jul 07 22:05:52 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] Acquiring lock "cinder-615fe9a4-de34-4526-a7b7-d3587330a562-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:05:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "cinder-615fe9a4-de34-4526-a7b7-d3587330a562-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:05:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] Acquiring lock "cinder-quobyte-939ed19e-382b-4c34-8b3f-ae1a3e57936c" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:05:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "cinder-quobyte-939ed19e-382b-4c34-8b3f-ae1a3e57936c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:05:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] Acquiring lock "cinder-quobyte-615fe9a4-de34-4526-a7b7-d3587330a562" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:05:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "cinder-quobyte-615fe9a4-de34-4526-a7b7-d3587330a562" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:05:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] Deleting offline snapshot 615fe9a4-de34-4526-a7b7-d3587330a562 of volume 939ed19e-382b-4c34-8b3f-ae1a3e57936c {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:05:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] snapshot_file for this snap is: volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.615fe9a4-de34-4526-a7b7-d3587330a562 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:05:52 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9eda47-6fd3-4b30-bf8a-7de88ea186e3]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.615fe9a4-de34-4526-a7b7-d3587330a562 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:52 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.615fe9a4-de34-4526-a7b7-d3587330a562 Jul 07 22:05:52 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:53 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b 1G" returned: 0 in 1.002s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:53 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b Jul 07 22:05:53 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:53 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.615fe9a4-de34-4526-a7b7-d3587330a562" returned: 0 in 0.872s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:53 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:05:53 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3637b97-c608-49a6-9087-8ad3989dec12]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:53 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:05:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Flow 'volume_create_manager' (507a0bec-55ae-4edc-86f2-31e8ff23aea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:05:53 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 Jul 07 22:05:53 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ab9c1c-dbdf-487c-8c0c-5a1a8da0d295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ab9c1c-dbdf-487c-8c0c-5a1a8da0d295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1841516339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b2824ec700c49408b041217be3158de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:05:54Z,use_quota=True,user_id='630b277b84934488a0e005148fa4800f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8360dbcc-b68f-4e46-bd65-30ade5b35214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8360dbcc-b68f-4e46-bd65-30ade5b35214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (896ca3b7-71ad-4691-a371-ec688e959b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (896ca3b7-71ad-4691-a371-ec688e959b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc', 'volume_name': 'volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269a01b2-561d-4241-8d7f-96989fa795ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269a01b2-561d-4241-8d7f-96989fa795ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:05:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b8cbda-bcc4-4879-9a5d-bb1e19b2814f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:05:53 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Volume 5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc', 'volume_size': 1} Jul 07 22:05:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:54 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b" returned: 0 in 0.983s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:54 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b is being set with open permissions: ugo+rw Jul 07 22:05:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:54 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b Jul 07 22:05:54 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:54 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52" returned: 0 in 1.049s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:54 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:05:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.615fe9a4-de34-4526-a7b7-d3587330a562 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:54 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.615fe9a4-de34-4526-a7b7-d3587330a562 Jul 07 22:05:54 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:55 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b" returned: 0 in 0.754s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:55 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.info Jul 07 22:05:55 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:55 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.615fe9a4-de34-4526-a7b7-d3587330a562" returned: 0 in 0.964s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.615fe9a4-de34-4526-a7b7-d3587330a562 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:55 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.615fe9a4-de34-4526-a7b7-d3587330a562 Jul 07 22:05:55 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:55 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.info" returned: 0 in 0.702s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:55 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.info is being set with open permissions: ugo+rw Jul 07 22:05:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:56 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.info Jul 07 22:05:56 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:56 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.615fe9a4-de34-4526-a7b7-d3587330a562" returned: 0 in 0.628s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "cinder-quobyte-615fe9a4-de34-4526-a7b7-d3587330a562" released by "_delete_snapshot" :: held 3.640s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "cinder-quobyte-939ed19e-382b-4c34-8b3f-ae1a3e57936c" released by "delete_snapshot" :: held 3.677s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] Created reservations ['f5a7d07a-5562-46c3-8736-565e462f7ffe', 'a9486c83-99a6-4e2e-90b3-75acd541acad', 'd7656a80-367a-41ed-a6ba-c78f3df1d568', '3a058513-bf62-4292-87ca-6675773a5ab2'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:05:56 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] Delete snapshot completed successfully. Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d89962b5-e746-491a-8646-581669f89b0d tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "cinder-615fe9a4-de34-4526-a7b7-d3587330a562-delete_snapshot" released by "delete_snapshot" :: held 3.850s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:05:56 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.info" returned: 0 in 0.650s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Acquiring lock "cinder-quobyte-8170b80d-a9fd-4f40-a726-0796587cec7f" by "_copy_volume_from_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Lock "cinder-quobyte-8170b80d-a9fd-4f40-a726-0796587cec7f" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] snapshot: 8bd051cd-e15e-4658-83a5-a6d7b3bed83b, volume: 8170b80d-a9fd-4f40-a726-0796587cec7f, {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76004eb-6627-4a68-992a-d3fe77e4dfdb]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] Acquiring lock "cinder-bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "cinder-bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] Acquiring lock "cinder-quobyte-939ed19e-382b-4c34-8b3f-ae1a3e57936c" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:05:56 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b Jul 07 22:05:56 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "cinder-quobyte-939ed19e-382b-4c34-8b3f-ae1a3e57936c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] Acquiring lock "cinder-quobyte-bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "cinder-quobyte-bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] Deleting offline snapshot bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 of volume 939ed19e-382b-4c34-8b3f-ae1a3e57936c {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] snapshot_file for this snap is: volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[67879f49-729b-4a0c-bc97-a2df6b995b5a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:57 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 Jul 07 22:05:57 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:57 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b" returned: 0 in 0.793s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04506795-ee66-424f-8cf3-ba7ba4907ce7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:05:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:05:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Creating direct copy from snapshot {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:05:57 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fbd15d-4138-455e-b87a-2eda4955477f]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:57 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 Jul 07 22:05:57 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:57 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52" returned: 0 in 0.748s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:05:57 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[705a046c-bf2d-4de9-94e6-3626ecc80a20]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:05:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:57 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca Jul 07 22:05:57 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:58 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7" returned: 0 in 0.791s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:58 devstack cinder-volume[87586]: DEBUG cinder.utils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Path /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8170b80d-a9fd-4f40-a726-0796587cec7f not found in is_blk_device check {{(pid=87586) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:05:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8170b80d-a9fd-4f40-a726-0796587cec7f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:58 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8170b80d-a9fd-4f40-a726-0796587cec7f Jul 07 22:05:58 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:58 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca" returned: 0 in 0.751s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:05:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:58 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 Jul 07 22:05:58 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:05:59 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Jul 07 22:05:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52" returned: 0 in 1.113s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:05:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:05:59 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52 Jul 07 22:05:59 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:00 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52" returned: 0 in 1.436s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:01 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "cinder-quobyte-bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52" released by "_delete_snapshot" :: held 4.195s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:01 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "cinder-quobyte-939ed19e-382b-4c34-8b3f-ae1a3e57936c" released by "delete_snapshot" :: held 4.233s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:01 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] Created reservations ['34f4288f-6aa7-40a2-a8a8-dc3d923425da', '8ec6809e-f57f-416b-bcbd-f05c0481e330', 'be6438e2-0f88-42cf-ac78-1f14e9398605', 'da027d5c-c737-41d2-97f1-8d02a498a16b'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:06:01 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] Delete snapshot completed successfully. Jul 07 22:06:01 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e0645de2-e181-453a-b89c-76f344e3acd8 tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "cinder-bdcfcf15-0c3f-4b47-a6f3-9afe34f2ce52-delete_snapshot" released by "delete_snapshot" :: held 4.612s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-99f05518-1fc7-43cd-bb0a-66888a7cc132 tempest-VolumesSnapshotListTestJSON-112825714 None] Acquiring lock "cinder-bbf9a156-f3e6-4395-b69c-22a727b254ca-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:06:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-99f05518-1fc7-43cd-bb0a-66888a7cc132 tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "cinder-bbf9a156-f3e6-4395-b69c-22a727b254ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:06:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-99f05518-1fc7-43cd-bb0a-66888a7cc132 tempest-VolumesSnapshotListTestJSON-112825714 None] Acquiring lock "cinder-quobyte-939ed19e-382b-4c34-8b3f-ae1a3e57936c" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:06:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-99f05518-1fc7-43cd-bb0a-66888a7cc132 tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "cinder-quobyte-939ed19e-382b-4c34-8b3f-ae1a3e57936c" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:06:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-99f05518-1fc7-43cd-bb0a-66888a7cc132 tempest-VolumesSnapshotListTestJSON-112825714 None] Acquiring lock "cinder-quobyte-bbf9a156-f3e6-4395-b69c-22a727b254ca" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:06:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-99f05518-1fc7-43cd-bb0a-66888a7cc132 tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "cinder-quobyte-bbf9a156-f3e6-4395-b69c-22a727b254ca" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:06:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-99f05518-1fc7-43cd-bb0a-66888a7cc132 tempest-VolumesSnapshotListTestJSON-112825714 None] Deleting offline snapshot bbf9a156-f3e6-4395-b69c-22a727b254ca of volume 939ed19e-382b-4c34-8b3f-ae1a3e57936c {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:06:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-99f05518-1fc7-43cd-bb0a-66888a7cc132 tempest-VolumesSnapshotListTestJSON-112825714 None] snapshot_file for this snap is: volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:06:02 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90b0ccf-69c5-4d68-ab2b-40ae68ad8aab]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-99f05518-1fc7-43cd-bb0a-66888a7cc132 tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:02 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca Jul 07 22:06:02 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:03 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8170b80d-a9fd-4f40-a726-0796587cec7f" returned: 0 in 5.379s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:03 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2106960f-fcbb-4aca-a45b-bb9a41d08ae1]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:03 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 Jul 07 22:06:03 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:04 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-99f05518-1fc7-43cd-bb0a-66888a7cc132 tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca" returned: 0 in 1.417s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:04 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-99f05518-1fc7-43cd-bb0a-66888a7cc132 tempest-VolumesSnapshotListTestJSON-112825714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:06:04 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae577174-ce00-48a0-b5e0-e290dbc1f1df]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-99f05518-1fc7-43cd-bb0a-66888a7cc132 tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:04 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c Jul 07 22:06:04 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:04 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7" returned: 0 in 1.050s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:04 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Image conversion details: src /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7, size 1024.00 MB, duration 5.38 sec, destination /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8170b80d-a9fd-4f40-a726-0796587cec7f {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:06:04 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Converted 1024.00 MB image at 190.32 MB/s Jul 07 22:06:04 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8170b80d-a9fd-4f40-a726-0796587cec7f is being set with open permissions: ugo+rw Jul 07 22:06:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8170b80d-a9fd-4f40-a726-0796587cec7f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:04 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8170b80d-a9fd-4f40-a726-0796587cec7f Jul 07 22:06:04 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:04 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-99f05518-1fc7-43cd-bb0a-66888a7cc132 tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c" returned: 0 in 0.885s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-99f05518-1fc7-43cd-bb0a-66888a7cc132 tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:04 devstack sudo[100362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca Jul 07 22:06:04 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:05 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8170b80d-a9fd-4f40-a726-0796587cec7f" returned: 0 in 0.683s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:05 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Lock "cinder-quobyte-8170b80d-a9fd-4f40-a726-0796587cec7f" released by "_copy_volume_from_snapshot" :: held 8.795s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:05 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Acquiring lock "cinder-quobyte-8bd051cd-e15e-4658-83a5-a6d7b3bed83b" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:06:05 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Lock "cinder-quobyte-8bd051cd-e15e-4658-83a5-a6d7b3bed83b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:06:05 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Deleting offline snapshot 8bd051cd-e15e-4658-83a5-a6d7b3bed83b of volume 04506795-ee66-424f-8cf3-ba7ba4907ce7 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:06:05 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] snapshot_file for this snap is: volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:06:05 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23e1b2d-1251-4dd1-a808-86c2aeb391c5]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:05 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b Jul 07 22:06:05 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:05 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-99f05518-1fc7-43cd-bb0a-66888a7cc132 tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca" returned: 0 in 0.887s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-99f05518-1fc7-43cd-bb0a-66888a7cc132 tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:05 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca Jul 07 22:06:05 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:06 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b" returned: 0 in 0.941s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04506795-ee66-424f-8cf3-ba7ba4907ce7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:06:06 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b74980-023d-4023-94a6-dafd1d2481d3]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:06 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-99f05518-1fc7-43cd-bb0a-66888a7cc132 tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c.bbf9a156-f3e6-4395-b69c-22a727b254ca" returned: 0 in 0.751s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:06 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-99f05518-1fc7-43cd-bb0a-66888a7cc132 tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "cinder-quobyte-bbf9a156-f3e6-4395-b69c-22a727b254ca" released by "_delete_snapshot" :: held 4.120s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:06 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-99f05518-1fc7-43cd-bb0a-66888a7cc132 tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "cinder-quobyte-939ed19e-382b-4c34-8b3f-ae1a3e57936c" released by "delete_snapshot" :: held 4.173s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:06 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 Jul 07 22:06:06 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:06 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-99f05518-1fc7-43cd-bb0a-66888a7cc132 tempest-VolumesSnapshotListTestJSON-112825714 None] Created reservations ['a6473254-8dae-45d9-bffc-6f3157c70fa3', 'df7e4ba9-ed22-4ba8-a1bf-fb5c25866470', 'e85d069c-088d-4f3c-ab51-77c85adab93f', 'a4e83088-fe50-42cb-9f4f-8da3eb1d25ae'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:06:06 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-99f05518-1fc7-43cd-bb0a-66888a7cc132 tempest-VolumesSnapshotListTestJSON-112825714 None] Delete snapshot completed successfully. Jul 07 22:06:06 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-99f05518-1fc7-43cd-bb0a-66888a7cc132 tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "cinder-bbf9a156-f3e6-4395-b69c-22a727b254ca-delete_snapshot" released by "delete_snapshot" :: held 4.414s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:07 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7" returned: 0 in 0.863s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:07 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b Jul 07 22:06:07 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f2f9392d-3123-42f0-8f26-6efb4717e88b tempest-VolumesSnapshotListTestJSON-112825714 None] Acquiring lock "cinder-939ed19e-382b-4c34-8b3f-ae1a3e57936c-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:06:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f2f9392d-3123-42f0-8f26-6efb4717e88b tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "cinder-939ed19e-382b-4c34-8b3f-ae1a3e57936c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:06:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f2f9392d-3123-42f0-8f26-6efb4717e88b tempest-VolumesSnapshotListTestJSON-112825714 None] Acquiring lock "cinder-quobyte-939ed19e-382b-4c34-8b3f-ae1a3e57936c" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:06:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f2f9392d-3123-42f0-8f26-6efb4717e88b tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "cinder-quobyte-939ed19e-382b-4c34-8b3f-ae1a3e57936c" acquired by "delete_volume" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:06:08 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e820b6-ab9c-443c-bae0-ab3ca584022f]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f2f9392d-3123-42f0-8f26-6efb4717e88b tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:08 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c Jul 07 22:06:08 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:08 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b" returned: 0 in 0.915s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:08 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b Jul 07 22:06:08 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:09 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f2f9392d-3123-42f0-8f26-6efb4717e88b tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c" returned: 0 in 0.956s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f2f9392d-3123-42f0-8f26-6efb4717e88b tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:09 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c Jul 07 22:06:09 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:09 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7.8bd051cd-e15e-4658-83a5-a6d7b3bed83b" returned: 0 in 0.826s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:09 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Lock "cinder-quobyte-8bd051cd-e15e-4658-83a5-a6d7b3bed83b" released by "_delete_snapshot" :: held 3.649s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.967s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:06:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.364s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:06:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1841516339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b2824ec700c49408b041217be3158de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:05:54Z,use_quota=True,user_id='630b277b84934488a0e005148fa4800f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:06:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Creating volume 5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:06:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:06:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:06:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:06:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:06:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:06:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:06:09 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:06:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ceefb93-fee1-4d29-bae6-8ca505a5c7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8170b80d-a9fd-4f40-a726-0796587cec7f', 'volume_size': 2, 'source_volid': '04506795-ee66-424f-8cf3-ba7ba4907ce7', 'source_volstatus': 'available'}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:09 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc 1073741824 Jul 07 22:06:09 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80298979-a0e4-4123-b5cb-20bc03f3710d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:09 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Volume volume-8170b80d-a9fd-4f40-a726-0796587cec7f (8170b80d-a9fd-4f40-a726-0796587cec7f): created successfully Jul 07 22:06:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80298979-a0e4-4123-b5cb-20bc03f3710d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Flow 'volume_create_manager' (fb326254-9dcd-45fa-b666-93eb32e878ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:06:09 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-9c7bc85c-4ab8-4e21-8720-df13a3b25590 tempest-VolumesCloneTest-1160812802 None] Created volume successfully. Jul 07 22:06:09 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f2f9392d-3123-42f0-8f26-6efb4717e88b tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-939ed19e-382b-4c34-8b3f-ae1a3e57936c" returned: 0 in 0.766s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:09 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f2f9392d-3123-42f0-8f26-6efb4717e88b tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "cinder-quobyte-939ed19e-382b-4c34-8b3f-ae1a3e57936c" released by "delete_volume" :: held 1.798s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:09 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-f2f9392d-3123-42f0-8f26-6efb4717e88b tempest-VolumesSnapshotListTestJSON-112825714 None] Created reservations ['7bc4fd57-4836-4a99-8212-7d3e53fc0f01', '6a6a6fa8-5277-4eb7-9e98-4ba77ab3b413', '935a7134-f7c0-48bc-9d75-dfebaf592098', 'ffcca9c5-afe4-4980-8bd4-6d8345204f6f'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:06:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f2f9392d-3123-42f0-8f26-6efb4717e88b tempest-VolumesSnapshotListTestJSON-112825714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:06:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f2f9392d-3123-42f0-8f26-6efb4717e88b tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:06:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f2f9392d-3123-42f0-8f26-6efb4717e88b tempest-VolumesSnapshotListTestJSON-112825714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:06:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f2f9392d-3123-42f0-8f26-6efb4717e88b tempest-VolumesSnapshotListTestJSON-112825714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:06:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f2f9392d-3123-42f0-8f26-6efb4717e88b tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:06:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f2f9392d-3123-42f0-8f26-6efb4717e88b tempest-VolumesSnapshotListTestJSON-112825714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:10 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:06:10 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:10 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7415c341-29df-4fbe-938c-a60038c0542f tempest-VolumesCloneTest-1160812802 None] Acquiring lock "cinder-8170b80d-a9fd-4f40-a726-0796587cec7f-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:06:10 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc 1073741824" returned: 0 in 1.157s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:10 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7415c341-29df-4fbe-938c-a60038c0542f tempest-VolumesCloneTest-1160812802 None] Lock "cinder-8170b80d-a9fd-4f40-a726-0796587cec7f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:06:10 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7415c341-29df-4fbe-938c-a60038c0542f tempest-VolumesCloneTest-1160812802 None] Acquiring lock "cinder-quobyte-8170b80d-a9fd-4f40-a726-0796587cec7f" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:06:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:10 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7415c341-29df-4fbe-938c-a60038c0542f tempest-VolumesCloneTest-1160812802 None] Lock "cinder-quobyte-8170b80d-a9fd-4f40-a726-0796587cec7f" acquired by "delete_volume" :: waited 0.034s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:06:10 devstack sudo[100407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc Jul 07 22:06:10 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:10 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b49043-99ed-4b06-b9aa-47e2934fa922]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7415c341-29df-4fbe-938c-a60038c0542f tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8170b80d-a9fd-4f40-a726-0796587cec7f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:10 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8170b80d-a9fd-4f40-a726-0796587cec7f Jul 07 22:06:10 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:11 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f2f9392d-3123-42f0-8f26-6efb4717e88b tempest-VolumesSnapshotListTestJSON-112825714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.012s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:11 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-f2f9392d-3123-42f0-8f26-6efb4717e88b tempest-VolumesSnapshotListTestJSON-112825714 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:06:11 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-f2f9392d-3123-42f0-8f26-6efb4717e88b tempest-VolumesSnapshotListTestJSON-112825714 None] Deleted volume successfully. Jul 07 22:06:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f2f9392d-3123-42f0-8f26-6efb4717e88b tempest-VolumesSnapshotListTestJSON-112825714 None] Lock "cinder-939ed19e-382b-4c34-8b3f-ae1a3e57936c-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:11 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc" returned: 0 in 0.988s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:11 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] <== create_volume: return (2221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:06:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.224s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:06:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b8cbda-bcc4-4879-9a5d-bb1e19b2814f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f823459-a960-4c56-8ed0-ff4781d320d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:11 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Volume volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc (5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc): created successfully Jul 07 22:06:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f823459-a960-4c56-8ed0-ff4781d320d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Flow 'volume_create_manager' (507a0bec-55ae-4edc-86f2-31e8ff23aea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:06:11 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-849659c0-4c2f-4a42-8328-0eb0f8fa08a2 tempest-VolumeDependencyTests-506434579 None] Created volume successfully. Jul 07 22:06:11 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7415c341-29df-4fbe-938c-a60038c0542f tempest-VolumesCloneTest-1160812802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8170b80d-a9fd-4f40-a726-0796587cec7f" returned: 0 in 1.133s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7415c341-29df-4fbe-938c-a60038c0542f tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8170b80d-a9fd-4f40-a726-0796587cec7f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:11 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8170b80d-a9fd-4f40-a726-0796587cec7f Jul 07 22:06:11 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:12 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7415c341-29df-4fbe-938c-a60038c0542f tempest-VolumesCloneTest-1160812802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8170b80d-a9fd-4f40-a726-0796587cec7f" returned: 0 in 0.754s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:12 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7415c341-29df-4fbe-938c-a60038c0542f tempest-VolumesCloneTest-1160812802 None] Lock "cinder-quobyte-8170b80d-a9fd-4f40-a726-0796587cec7f" released by "delete_volume" :: held 1.975s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:12 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-7415c341-29df-4fbe-938c-a60038c0542f tempest-VolumesCloneTest-1160812802 None] Created reservations ['2b43c603-ee4e-4e21-b342-b373e7ba4d9c', '613927af-5ed2-49ab-829b-09b5a1f8ec12', '3bdd697a-be30-412c-84e0-e3924dff744c', '2a500192-c1c5-40d1-975a-b28cb08f6ade'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:06:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7415c341-29df-4fbe-938c-a60038c0542f tempest-VolumesCloneTest-1160812802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:06:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7415c341-29df-4fbe-938c-a60038c0542f tempest-VolumesCloneTest-1160812802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:06:12 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7415c341-29df-4fbe-938c-a60038c0542f tempest-VolumesCloneTest-1160812802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:06:12 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7415c341-29df-4fbe-938c-a60038c0542f tempest-VolumesCloneTest-1160812802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:06:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7415c341-29df-4fbe-938c-a60038c0542f tempest-VolumesCloneTest-1160812802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:06:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7415c341-29df-4fbe-938c-a60038c0542f tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:12 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:06:12 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:12 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ce4d3038-a47a-42eb-80fe-3418a7ebeeed tempest-VolumesCloneTest-1160812802 None] Acquiring lock "cinder-04506795-ee66-424f-8cf3-ba7ba4907ce7-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:06:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-71f645a7-6bf0-4a63-b1ba-a408a7397198 tempest-VolumeDependencyTests-506434579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:06:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-71f645a7-6bf0-4a63-b1ba-a408a7397198 tempest-VolumeDependencyTests-506434579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:06:12 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-71f645a7-6bf0-4a63-b1ba-a408a7397198 tempest-VolumeDependencyTests-506434579 None] Creating offline snapshot 722416e7-4b2d-4496-b0d7-ceb915c7c014 of volume 5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:06:12 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ce4d3038-a47a-42eb-80fe-3418a7ebeeed tempest-VolumesCloneTest-1160812802 None] Lock "cinder-04506795-ee66-424f-8cf3-ba7ba4907ce7-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:06:12 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7393627a-dc22-49a2-a0be-7a910a0d25a2]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-71f645a7-6bf0-4a63-b1ba-a408a7397198 tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ce4d3038-a47a-42eb-80fe-3418a7ebeeed tempest-VolumesCloneTest-1160812802 None] Acquiring lock "cinder-quobyte-04506795-ee66-424f-8cf3-ba7ba4907ce7" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:06:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ce4d3038-a47a-42eb-80fe-3418a7ebeeed tempest-VolumesCloneTest-1160812802 None] Lock "cinder-quobyte-04506795-ee66-424f-8cf3-ba7ba4907ce7" acquired by "delete_volume" :: waited 0.034s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:06:13 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc Jul 07 22:06:13 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:13 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebaae61-b828-4345-8a59-41e6e4cf8597]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ce4d3038-a47a-42eb-80fe-3418a7ebeeed tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:13 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 Jul 07 22:06:13 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:13 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7415c341-29df-4fbe-938c-a60038c0542f tempest-VolumesCloneTest-1160812802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.994s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:13 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-7415c341-29df-4fbe-938c-a60038c0542f tempest-VolumesCloneTest-1160812802 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:06:13 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-7415c341-29df-4fbe-938c-a60038c0542f tempest-VolumesCloneTest-1160812802 None] Deleted volume successfully. Jul 07 22:06:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7415c341-29df-4fbe-938c-a60038c0542f tempest-VolumesCloneTest-1160812802 None] Lock "cinder-8170b80d-a9fd-4f40-a726-0796587cec7f-delete_volume" released by "delete_volume" :: held 3.317s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:14 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-71f645a7-6bf0-4a63-b1ba-a408a7397198 tempest-VolumeDependencyTests-506434579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc" returned: 0 in 1.162s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-71f645a7-6bf0-4a63-b1ba-a408a7397198 tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:14 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014 1G Jul 07 22:06:14 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:14 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ce4d3038-a47a-42eb-80fe-3418a7ebeeed tempest-VolumesCloneTest-1160812802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7" returned: 0 in 1.083s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ce4d3038-a47a-42eb-80fe-3418a7ebeeed tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:14 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7 Jul 07 22:06:14 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:15 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ce4d3038-a47a-42eb-80fe-3418a7ebeeed tempest-VolumesCloneTest-1160812802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-04506795-ee66-424f-8cf3-ba7ba4907ce7" returned: 0 in 0.877s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ce4d3038-a47a-42eb-80fe-3418a7ebeeed tempest-VolumesCloneTest-1160812802 None] Lock "cinder-quobyte-04506795-ee66-424f-8cf3-ba7ba4907ce7" released by "delete_volume" :: held 2.059s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:15 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-ce4d3038-a47a-42eb-80fe-3418a7ebeeed tempest-VolumesCloneTest-1160812802 None] Created reservations ['96ec4e66-1a1c-4832-bbad-389bfbefcdeb', '4b30aa85-6054-438e-b205-f8f07ab23fac', 'af29e6b6-3be1-44c9-bfa6-4525ea9deb09', 'f7f0583d-ad80-4a8c-af32-95fe0368e1a1'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:06:15 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-71f645a7-6bf0-4a63-b1ba-a408a7397198 tempest-VolumeDependencyTests-506434579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014 1G" returned: 0 in 1.138s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-71f645a7-6bf0-4a63-b1ba-a408a7397198 tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ce4d3038-a47a-42eb-80fe-3418a7ebeeed tempest-VolumesCloneTest-1160812802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:06:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ce4d3038-a47a-42eb-80fe-3418a7ebeeed tempest-VolumesCloneTest-1160812802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:06:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d3038-a47a-42eb-80fe-3418a7ebeeed tempest-VolumesCloneTest-1160812802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:06:15 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014 Jul 07 22:06:15 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d3038-a47a-42eb-80fe-3418a7ebeeed tempest-VolumesCloneTest-1160812802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:06:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ce4d3038-a47a-42eb-80fe-3418a7ebeeed tempest-VolumesCloneTest-1160812802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:06:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ce4d3038-a47a-42eb-80fe-3418a7ebeeed tempest-VolumesCloneTest-1160812802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:15 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:06:15 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:16 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ce4d3038-a47a-42eb-80fe-3418a7ebeeed tempest-VolumesCloneTest-1160812802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.798s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:16 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-ce4d3038-a47a-42eb-80fe-3418a7ebeeed tempest-VolumesCloneTest-1160812802 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:06:16 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ce4d3038-a47a-42eb-80fe-3418a7ebeeed tempest-VolumesCloneTest-1160812802 None] Deleted volume successfully. Jul 07 22:06:16 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-71f645a7-6bf0-4a63-b1ba-a408a7397198 tempest-VolumeDependencyTests-506434579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014" returned: 0 in 0.902s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:16 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-71f645a7-6bf0-4a63-b1ba-a408a7397198 tempest-VolumeDependencyTests-506434579 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014 is being set with open permissions: ugo+rw Jul 07 22:06:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-71f645a7-6bf0-4a63-b1ba-a408a7397198 tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ce4d3038-a47a-42eb-80fe-3418a7ebeeed tempest-VolumesCloneTest-1160812802 None] Lock "cinder-04506795-ee66-424f-8cf3-ba7ba4907ce7-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:16 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014 Jul 07 22:06:16 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:17 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-71f645a7-6bf0-4a63-b1ba-a408a7397198 tempest-VolumeDependencyTests-506434579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014" returned: 0 in 0.876s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-71f645a7-6bf0-4a63-b1ba-a408a7397198 tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:17 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.info Jul 07 22:06:17 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:17 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-71f645a7-6bf0-4a63-b1ba-a408a7397198 tempest-VolumeDependencyTests-506434579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.info" returned: 0 in 0.769s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:17 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-71f645a7-6bf0-4a63-b1ba-a408a7397198 tempest-VolumeDependencyTests-506434579 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.info is being set with open permissions: ugo+rw Jul 07 22:06:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-71f645a7-6bf0-4a63-b1ba-a408a7397198 tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:17 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.info Jul 07 22:06:17 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:18 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-71f645a7-6bf0-4a63-b1ba-a408a7397198 tempest-VolumeDependencyTests-506434579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.info" returned: 0 in 0.690s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-71f645a7-6bf0-4a63-b1ba-a408a7397198 tempest-VolumeDependencyTests-506434579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.717s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:06:18 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-71f645a7-6bf0-4a63-b1ba-a408a7397198 tempest-VolumeDependencyTests-506434579 None] Create snapshot completed successfully Jul 07 22:06:19 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:06:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Flow 'volume_create_manager' (0303a904-73c5-43ed-986f-6ecbffd63dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:06:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d86da50-6358-479b-bf20-04cb25339c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d86da50-6358-479b-bf20-04cb25339c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-385556524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6153a31-edd9-443c-b107-321c1c282295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b2824ec700c49408b041217be3158de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=722416e7-4b2d-4496-b0d7-ceb915c7c014,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:06:20Z,use_quota=True,user_id='630b277b84934488a0e005148fa4800f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3019847a-9b97-4775-a700-0787ff926c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3019847a-9b97-4775-a700-0787ff926c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b49dba-f654-4b76-ad41-55ac6a5ec5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b49dba-f654-4b76-ad41-55ac6a5ec5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd6153a31-edd9-443c-b107-321c1c282295', 'volume_name': 'volume-d6153a31-edd9-443c-b107-321c1c282295', 'volume_size': 1, 'snapshot_id': '722416e7-4b2d-4496-b0d7-ceb915c7c014'}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f839cab-04d4-4e5c-a721-d3f6c9c7a638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f839cab-04d4-4e5c-a721-d3f6c9c7a638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c63a80-a2c9-4a2e-9ebc-19c1fac39390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:19 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Volume d6153a31-edd9-443c-b107-321c1c282295: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d6153a31-edd9-443c-b107-321c1c282295', 'volume_size': 1, 'snapshot_id': '722416e7-4b2d-4496-b0d7-ceb915c7c014'} Jul 07 22:06:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:06:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:06:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Acquiring lock "cinder-quobyte-722416e7-4b2d-4496-b0d7-ceb915c7c014-d6153a31-edd9-443c-b107-321c1c282295" by "_create_volume_from_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:06:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Lock "cinder-quobyte-722416e7-4b2d-4496-b0d7-ceb915c7c014-d6153a31-edd9-443c-b107-321c1c282295" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:06:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Creating volume d6153a31-edd9-443c-b107-321c1c282295 from snapshot 722416e7-4b2d-4496-b0d7-ceb915c7c014 {{(pid=87586) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:06:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:06:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:06:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:06:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:06:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:06:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:06:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Acquiring lock "cinder-quobyte-d6153a31-edd9-443c-b107-321c1c282295" by "_copy_volume_from_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:06:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Lock "cinder-quobyte-d6153a31-edd9-443c-b107-321c1c282295" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:06:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] snapshot: 722416e7-4b2d-4496-b0d7-ceb915c7c014, volume: d6153a31-edd9-443c-b107-321c1c282295, {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:06:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:06:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:06:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:06:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:06:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:06:20 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[382f787c-68df-4c46-bf71-2f39d265299c]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:20 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014 Jul 07 22:06:20 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:21 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014" returned: 0 in 1.183s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:06:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:06:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Creating direct copy from snapshot {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:06:21 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d60f90-2f22-40cc-8ab5-13e36c537830]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:21 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc Jul 07 22:06:21 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:22 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:06:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Flow 'volume_create_manager' (a378fa73-26ba-4bfa-ba7a-f4b40cd521fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:06:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0f093e-fbe5-4a07-9480-9fc18a9be684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0f093e-fbe5-4a07-9480-9fc18a9be684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1797908133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00183ed97dc49108504123802f86e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:06:22Z,use_quota=True,user_id='82a171b886aa453cbf69599bec307061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed8c2ae9-64ad-4236-bb32-75ce6572907e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed8c2ae9-64ad-4236-bb32-75ce6572907e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa819fe6-9120-45c4-a2f8-e06393fdc1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:22 devstack cinder-volume[87586]: DEBUG cinder.image.glance [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Creating Keystone auth plugin from conf {{(pid=87586) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:06:22 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc" returned: 0 in 1.173s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:22 devstack cinder-volume[87586]: DEBUG cinder.utils [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Path /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d6153a31-edd9-443c-b107-321c1c282295 not found in is_blk_device check {{(pid=87586) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:06:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d6153a31-edd9-443c-b107-321c1c282295 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:22 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d6153a31-edd9-443c-b107-321c1c282295 Jul 07 22:06:22 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa819fe6-9120-45c4-a2f8-e06393fdc1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1', 'volume_name': 'volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1', 'volume_size': 1, 'image_id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '922c2d549e794c9ebc74bddfbafcb8e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'created_at': datetime.datetime(2026, 7, 7, 19, 46, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 19, 46, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4029b25-4150-4900-b501-56a8531d36dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4029b25-4150-4900-b501-56a8531d36dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9fb80c-668b-4935-8932-a8e65fd691f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:22 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Volume 50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1', 'volume_size': 1, 'image_id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '922c2d549e794c9ebc74bddfbafcb8e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'created_at': datetime.datetime(2026, 7, 7, 19, 46, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 19, 46, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 22:06:22 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Trying to clone 50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 from image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d at location (None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}]). {{(pid=87586) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:06:23 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_g7or2ij1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:06:23 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Image download 20.69 MB at 20.69 MB/s Jul 07 22:06:23 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[24300d85-f5ac-424b-9a54-32024fa8ce1f]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_g7or2ij1devstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:23 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_g7or2ij1devstack@QuobyteHD Jul 07 22:06:23 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:24 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_g7or2ij1devstack@QuobyteHD" returned: 0 in 1.105s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:24 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Temporary image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d is fetched for user 82a171b886aa453cbf69599bec307061. {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:06:24 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfe738b-2b6f-4c76-8a74-d4c2d851b4d4]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_g7or2ij1devstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:24 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_g7or2ij1devstack@QuobyteHD Jul 07 22:06:24 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:27 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_g7or2ij1devstack@QuobyteHD" returned: 0 in 2.784s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:06:29 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d6153a31-edd9-443c-b107-321c1c282295" returned: 0 in 6.826s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:29 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdca5f1-8ad2-4b7e-a032-1fe760576f62]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:29 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc Jul 07 22:06:29 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:30 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc" returned: 0 in 0.999s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:30 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Image conversion details: src /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc, size 1024.00 MB, duration 6.83 sec, destination /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d6153a31-edd9-443c-b107-321c1c282295 {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:06:30 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Converted 1024.00 MB image at 150.00 MB/s Jul 07 22:06:30 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d6153a31-edd9-443c-b107-321c1c282295 is being set with open permissions: ugo+rw Jul 07 22:06:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d6153a31-edd9-443c-b107-321c1c282295 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:30 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d6153a31-edd9-443c-b107-321c1c282295 Jul 07 22:06:30 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:30 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d6153a31-edd9-443c-b107-321c1c282295" returned: 0 in 0.659s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:30 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Lock "cinder-quobyte-d6153a31-edd9-443c-b107-321c1c282295" released by "_copy_volume_from_snapshot" :: held 10.969s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Lock "cinder-quobyte-722416e7-4b2d-4496-b0d7-ceb915c7c014-d6153a31-edd9-443c-b107-321c1c282295" released by "_create_volume_from_snapshot" :: held 11.007s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.027s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:06:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.559s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:06:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1797908133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00183ed97dc49108504123802f86e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:06:22Z,use_quota=True,user_id='82a171b886aa453cbf69599bec307061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:06:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Creating volume 50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:06:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:06:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:06:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:06:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:06:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:06:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:06:31 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:06:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:31 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 1073741824 Jul 07 22:06:31 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:31 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 1073741824" returned: 0 in 0.877s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c63a80-a2c9-4a2e-9ebc-19c1fac39390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6153a31-edd9-443c-b107-321c1c282295', 'volume_size': 1, 'snapshot_id': '722416e7-4b2d-4496-b0d7-ceb915c7c014'}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a57bd72-d119-4767-8827-12ada7f9aa42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:34 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Volume volume-d6153a31-edd9-443c-b107-321c1c282295 (d6153a31-edd9-443c-b107-321c1c282295): created successfully Jul 07 22:06:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a57bd72-d119-4767-8827-12ada7f9aa42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Flow 'volume_create_manager' (0303a904-73c5-43ed-986f-6ecbffd63dc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:06:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:34 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 Jul 07 22:06:34 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:35 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-e3ec47ad-d406-4ab1-92ef-38ec780239f4 tempest-VolumeDependencyTests-506434579 None] Created volume successfully. Jul 07 22:06:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-03178b8f-0c8f-428c-a573-eac37a9cd1be tempest-VolumeDependencyTests-506434579 None] Acquiring lock "cinder-722416e7-4b2d-4496-b0d7-ceb915c7c014-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:06:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:06:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:06:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:06:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:06:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:06:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:06:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:35 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:06:35 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-03178b8f-0c8f-428c-a573-eac37a9cd1be tempest-VolumeDependencyTests-506434579 None] Lock "cinder-722416e7-4b2d-4496-b0d7-ceb915c7c014-delete_snapshot" acquired by "delete_snapshot" :: waited 0.079s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:06:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-03178b8f-0c8f-428c-a573-eac37a9cd1be tempest-VolumeDependencyTests-506434579 None] Acquiring lock "cinder-quobyte-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:06:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-03178b8f-0c8f-428c-a573-eac37a9cd1be tempest-VolumeDependencyTests-506434579 None] Lock "cinder-quobyte-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:06:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-03178b8f-0c8f-428c-a573-eac37a9cd1be tempest-VolumeDependencyTests-506434579 None] Acquiring lock "cinder-quobyte-722416e7-4b2d-4496-b0d7-ceb915c7c014" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:06:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-03178b8f-0c8f-428c-a573-eac37a9cd1be tempest-VolumeDependencyTests-506434579 None] Lock "cinder-quobyte-722416e7-4b2d-4496-b0d7-ceb915c7c014" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:06:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-03178b8f-0c8f-428c-a573-eac37a9cd1be tempest-VolumeDependencyTests-506434579 None] Deleting offline snapshot 722416e7-4b2d-4496-b0d7-ceb915c7c014 of volume 5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:06:35 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-03178b8f-0c8f-428c-a573-eac37a9cd1be tempest-VolumeDependencyTests-506434579 None] snapshot_file for this snap is: volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:06:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1" returned: 0 in 0.827s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] <== create_volume: return (4746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:06:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.749s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:06:35 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb0cdbf-3e62-4480-bae6-50e872b872b2]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-03178b8f-0c8f-428c-a573-eac37a9cd1be tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:35 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Attempting download of 3ab6a905-2c25-4ca7-8034-1de3dbd6512d ((None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}])) to volume 50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1. {{(pid=87586) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:06:35 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014 Jul 07 22:06:35 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:36 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[281dec89-7b11-4d73-920c-7658ad4ac584]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_sitzc16d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:36 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_sitzc16d Jul 07 22:06:36 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:36 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.378s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:06:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:06:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 28 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 22:06:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 22:06:37 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-03178b8f-0c8f-428c-a573-eac37a9cd1be tempest-VolumeDependencyTests-506434579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014" returned: 0 in 1.256s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-03178b8f-0c8f-428c-a573-eac37a9cd1be tempest-VolumeDependencyTests-506434579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:06:37 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9aed84-9778-42de-b5d0-149aed1228ff]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-03178b8f-0c8f-428c-a573-eac37a9cd1be tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:37 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc Jul 07 22:06:37 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:37 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_sitzc16d" returned: 0 in 1.258s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_sitzc16d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:38 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_sitzc16d Jul 07 22:06:38 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:38 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-03178b8f-0c8f-428c-a573-eac37a9cd1be tempest-VolumeDependencyTests-506434579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc" returned: 0 in 0.988s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-03178b8f-0c8f-428c-a573-eac37a9cd1be tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:38 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014 Jul 07 22:06:38 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:38 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_sitzc16d" returned: 1 in 1.081s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_sitzc16d' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:06:38 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c835198f-f233-42af-b88a-1e147e23c6b8]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_g7or2ij1devstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:39 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_g7or2ij1devstack@QuobyteHD Jul 07 22:06:39 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:39 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-03178b8f-0c8f-428c-a573-eac37a9cd1be tempest-VolumeDependencyTests-506434579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014" returned: 0 in 1.038s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-03178b8f-0c8f-428c-a573-eac37a9cd1be tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:39 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014 Jul 07 22:06:39 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:39 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_g7or2ij1devstack@QuobyteHD" returned: 0 in 0.909s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:39 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] 3ab6a905-2c25-4ca7-8034-1de3dbd6512d was qcow2, converting to raw {{(pid=87586) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:06:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_g7or2ij1devstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:39 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_g7or2ij1devstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 Jul 07 22:06:39 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:39 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-03178b8f-0c8f-428c-a573-eac37a9cd1be tempest-VolumeDependencyTests-506434579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc.722416e7-4b2d-4496-b0d7-ceb915c7c014" returned: 0 in 0.773s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-03178b8f-0c8f-428c-a573-eac37a9cd1be tempest-VolumeDependencyTests-506434579 None] Lock "cinder-quobyte-722416e7-4b2d-4496-b0d7-ceb915c7c014" released by "_delete_snapshot" :: held 4.246s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-03178b8f-0c8f-428c-a573-eac37a9cd1be tempest-VolumeDependencyTests-506434579 None] Lock "cinder-quobyte-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc" released by "delete_snapshot" :: held 4.294s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:40 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-03178b8f-0c8f-428c-a573-eac37a9cd1be tempest-VolumeDependencyTests-506434579 None] Created reservations ['1bb93ee0-bb2d-4083-a7a5-f714959e74c4', 'f1ed84a4-d24f-4667-9c1d-076037aa9d00', '3dbe0c76-4d86-43d9-bab8-aa94b4d3d0e6', '995aaf66-873e-456a-9cde-9f84d9e28a43'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:06:40 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-03178b8f-0c8f-428c-a573-eac37a9cd1be tempest-VolumeDependencyTests-506434579 None] Delete snapshot completed successfully. Jul 07 22:06:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-03178b8f-0c8f-428c-a573-eac37a9cd1be tempest-VolumeDependencyTests-506434579 None] Lock "cinder-722416e7-4b2d-4496-b0d7-ceb915c7c014-delete_snapshot" released by "delete_snapshot" :: held 4.517s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-11c515a7-181c-4c10-b25a-447b49601c0b tempest-VolumeDependencyTests-506434579 None] Acquiring lock "cinder-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:06:41 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-11c515a7-181c-4c10-b25a-447b49601c0b tempest-VolumeDependencyTests-506434579 None] Lock "cinder-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:06:41 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-11c515a7-181c-4c10-b25a-447b49601c0b tempest-VolumeDependencyTests-506434579 None] Acquiring lock "cinder-quobyte-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:06:41 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-11c515a7-181c-4c10-b25a-447b49601c0b tempest-VolumeDependencyTests-506434579 None] Lock "cinder-quobyte-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc" acquired by "delete_volume" :: waited 0.025s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:06:41 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[34980202-c886-4380-9e77-66115c994827]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-11c515a7-181c-4c10-b25a-447b49601c0b tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:41 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc Jul 07 22:06:41 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:42 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-11c515a7-181c-4c10-b25a-447b49601c0b tempest-VolumeDependencyTests-506434579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc" returned: 0 in 0.891s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-11c515a7-181c-4c10-b25a-447b49601c0b tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:42 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:42 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc Jul 07 22:06:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_g7or2ij1devstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1" returned: 0 in 2.269s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:42 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_g7or2ij1devstack@QuobyteHD, size 112.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:06:42 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:42 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Converted 112.00 MB image at 49.33 MB/s Jul 07 22:06:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:42 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 1G Jul 07 22:06:42 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:43 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 1G" returned: 0 in 0.897s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:43 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-11c515a7-181c-4c10-b25a-447b49601c0b tempest-VolumeDependencyTests-506434579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc" returned: 0 in 0.990s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:43 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d59529-07a8-4319-b197-52fbcdc3784a]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-11c515a7-181c-4c10-b25a-447b49601c0b tempest-VolumeDependencyTests-506434579 None] Lock "cinder-quobyte-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc" released by "delete_volume" :: held 2.004s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:43 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-11c515a7-181c-4c10-b25a-447b49601c0b tempest-VolumeDependencyTests-506434579 None] Created reservations ['61bc99ad-0898-49f2-bcbf-332e00e0004f', '99fe1a6a-b0d7-409f-87d1-581a62f7474a', 'b36dd048-8024-4c36-822a-877d07aeaa4a', '5ac0edcb-8893-48ba-9f75-f25c7e5baae5'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:06:43 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 Jul 07 22:06:43 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-11c515a7-181c-4c10-b25a-447b49601c0b tempest-VolumeDependencyTests-506434579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:06:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-11c515a7-181c-4c10-b25a-447b49601c0b tempest-VolumeDependencyTests-506434579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:06:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-11c515a7-181c-4c10-b25a-447b49601c0b tempest-VolumeDependencyTests-506434579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:06:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-11c515a7-181c-4c10-b25a-447b49601c0b tempest-VolumeDependencyTests-506434579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:06:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-11c515a7-181c-4c10-b25a-447b49601c0b tempest-VolumeDependencyTests-506434579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:06:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-11c515a7-181c-4c10-b25a-447b49601c0b tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:43 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:06:43 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b7cbabb5-f09b-4d67-aae4-bcb445064423 tempest-VolumeDependencyTests-506434579 None] Acquiring lock "cinder-d6153a31-edd9-443c-b107-321c1c282295-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:06:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b7cbabb5-f09b-4d67-aae4-bcb445064423 tempest-VolumeDependencyTests-506434579 None] Lock "cinder-d6153a31-edd9-443c-b107-321c1c282295-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:06:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b7cbabb5-f09b-4d67-aae4-bcb445064423 tempest-VolumeDependencyTests-506434579 None] Acquiring lock "cinder-quobyte-d6153a31-edd9-443c-b107-321c1c282295" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:06:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b7cbabb5-f09b-4d67-aae4-bcb445064423 tempest-VolumeDependencyTests-506434579 None] Lock "cinder-quobyte-d6153a31-edd9-443c-b107-321c1c282295" acquired by "delete_volume" :: waited 0.037s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:06:43 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28ccef1-e3e5-406b-a3f0-bdd7887727ef]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b7cbabb5-f09b-4d67-aae4-bcb445064423 tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d6153a31-edd9-443c-b107-321c1c282295 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:43 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d6153a31-edd9-443c-b107-321c1c282295 Jul 07 22:06:43 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:44 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1" returned: 0 in 1.277s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:44 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-11c515a7-181c-4c10-b25a-447b49601c0b tempest-VolumeDependencyTests-506434579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.182s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:44 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-11c515a7-181c-4c10-b25a-447b49601c0b tempest-VolumeDependencyTests-506434579 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:06:44 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-11c515a7-181c-4c10-b25a-447b49601c0b tempest-VolumeDependencyTests-506434579 None] Deleted volume successfully. Jul 07 22:06:44 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-11c515a7-181c-4c10-b25a-447b49601c0b tempest-VolumeDependencyTests-506434579 None] Lock "cinder-5bd3a792-e8b9-4f56-aa5f-3a1867ef9ddc-delete_volume" released by "delete_volume" :: held 3.489s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:44 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 Jul 07 22:06:44 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:44 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b7cbabb5-f09b-4d67-aae4-bcb445064423 tempest-VolumeDependencyTests-506434579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d6153a31-edd9-443c-b107-321c1c282295" returned: 0 in 1.108s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b7cbabb5-f09b-4d67-aae4-bcb445064423 tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d6153a31-edd9-443c-b107-321c1c282295 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:44 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d6153a31-edd9-443c-b107-321c1c282295 Jul 07 22:06:44 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:45 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1" returned: 1 in 1.010s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:06:45 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Downloaded image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d ((None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}])) to volume 50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 successfully. {{(pid=87586) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:06:45 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Temporary image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d for user 82a171b886aa453cbf69599bec307061 is deleted. {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:06:45 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Marking volume 50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 as bootable. {{(pid=87586) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:06:45 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Copying metadata from image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d to 50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1. {{(pid=87586) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:06:45 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Creating volume glance metadata for volume 50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 backed by image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87586) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:06:45 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b7cbabb5-f09b-4d67-aae4-bcb445064423 tempest-VolumeDependencyTests-506434579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d6153a31-edd9-443c-b107-321c1c282295" returned: 0 in 0.806s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:45 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b7cbabb5-f09b-4d67-aae4-bcb445064423 tempest-VolumeDependencyTests-506434579 None] Lock "cinder-quobyte-d6153a31-edd9-443c-b107-321c1c282295" released by "delete_volume" :: held 2.017s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9fb80c-668b-4935-8932-a8e65fd691f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1', 'volume_size': 1, 'image_id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '922c2d549e794c9ebc74bddfbafcb8e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'created_at': datetime.datetime(2026, 7, 7, 19, 46, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 19, 46, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f8392f-f2d8-4a6b-b81b-28979f069a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:45 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Volume volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 (50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1): created successfully Jul 07 22:06:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f8392f-f2d8-4a6b-b81b-28979f069a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Flow 'volume_create_manager' (a378fa73-26ba-4bfa-ba7a-f4b40cd521fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:06:45 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-992864a7-e3ca-47d4-ae72-1599ec286fa3 tempest-VolumesExtendTest-1015635940 None] Created volume successfully. Jul 07 22:06:45 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-b7cbabb5-f09b-4d67-aae4-bcb445064423 tempest-VolumeDependencyTests-506434579 None] Created reservations ['40bc2914-9e06-4a74-9e56-9f52a2580469', 'f1262ccb-46ce-43b2-a730-7de46b911112', 'b4392656-9bfa-42ce-96e8-a4cd364fbd3e', '418d3d0b-71de-478e-a063-6bde48809eaa'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:06:45 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=80,cinder:UPDATE=80,cinder:DELETE=5,cinder:INSERT=27 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:06:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b7cbabb5-f09b-4d67-aae4-bcb445064423 tempest-VolumeDependencyTests-506434579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:06:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b7cbabb5-f09b-4d67-aae4-bcb445064423 tempest-VolumeDependencyTests-506434579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:06:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b7cbabb5-f09b-4d67-aae4-bcb445064423 tempest-VolumeDependencyTests-506434579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:06:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b7cbabb5-f09b-4d67-aae4-bcb445064423 tempest-VolumeDependencyTests-506434579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:06:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b7cbabb5-f09b-4d67-aae4-bcb445064423 tempest-VolumeDependencyTests-506434579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:06:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b7cbabb5-f09b-4d67-aae4-bcb445064423 tempest-VolumeDependencyTests-506434579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:45 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:06:45 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:46 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b7cbabb5-f09b-4d67-aae4-bcb445064423 tempest-VolumeDependencyTests-506434579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.726s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:46 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-b7cbabb5-f09b-4d67-aae4-bcb445064423 tempest-VolumeDependencyTests-506434579 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:06:46 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-b7cbabb5-f09b-4d67-aae4-bcb445064423 tempest-VolumeDependencyTests-506434579 None] Deleted volume successfully. Jul 07 22:06:46 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b7cbabb5-f09b-4d67-aae4-bcb445064423 tempest-VolumeDependencyTests-506434579 None] Lock "cinder-d6153a31-edd9-443c-b107-321c1c282295-delete_volume" released by "delete_volume" :: held 3.127s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d5e058c3-b941-4de4-a393-3c237f8a6eb8 tempest-VolumesExtendTest-1015635940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:06:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d5e058c3-b941-4de4-a393-3c237f8a6eb8 tempest-VolumesExtendTest-1015635940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:06:46 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f7365c-9c60-4c1d-9064-e61525e13d82]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d5e058c3-b941-4de4-a393-3c237f8a6eb8 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:46 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 Jul 07 22:06:46 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:47 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d5e058c3-b941-4de4-a393-3c237f8a6eb8 tempest-VolumesExtendTest-1015635940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1" returned: 0 in 1.012s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d5e058c3-b941-4de4-a393-3c237f8a6eb8 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:47 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 Jul 07 22:06:47 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:48 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d5e058c3-b941-4de4-a393-3c237f8a6eb8 tempest-VolumesExtendTest-1015635940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1" returned: 1 in 0.915s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d5e058c3-b941-4de4-a393-3c237f8a6eb8 tempest-VolumesExtendTest-1015635940 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:06:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d5e058c3-b941-4de4-a393-3c237f8a6eb8 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 2G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d5e058c3-b941-4de4-a393-3c237f8a6eb8 tempest-VolumesExtendTest-1015635940 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 2G" returned: 0 in 0.096s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d5e058c3-b941-4de4-a393-3c237f8a6eb8 tempest-VolumesExtendTest-1015635940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.098s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:06:48 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:UPDATE=94,cinder:SELECT=75,cinder:INSERT=33,cinder:DELETE=7 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:06:48 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d5e058c3-b941-4de4-a393-3c237f8a6eb8 tempest-VolumesExtendTest-1015635940 None] Extend volume completed successfully. Jul 07 22:06:49 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] Acquiring lock "cinder-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:06:49 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] Lock "cinder-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:06:49 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] Acquiring lock "cinder-quobyte-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:06:49 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] Lock "cinder-quobyte-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1" acquired by "delete_volume" :: waited 0.030s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:06:49 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c428ba-49c8-4f6e-b0c2-7eb389d33575]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:49 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 Jul 07 22:06:49 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:50 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1" returned: 0 in 1.342s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:50 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 Jul 07 22:06:50 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:51 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1" returned: 1 in 0.950s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:06:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:51 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1 Jul 07 22:06:51 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:52 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1" returned: 0 in 0.807s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] Lock "cinder-quobyte-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1" released by "delete_volume" :: held 3.204s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:52 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] Created reservations ['3676e6b3-471f-4809-8fad-eb6d4921accb', 'ff04befe-85b9-48d3-933c-a6878545aa2f', '4f5759a1-d795-4608-baf3-7de8f2c2d45d', 'be42d2b3-44ff-4c81-9bc9-0cfa337ff704'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:06:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:06:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:06:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:06:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:06:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:06:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:52 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:06:52 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:53 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.913s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:53 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:06:53 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] Deleted volume successfully. Jul 07 22:06:53 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c3bbd4a1-e34d-4f4e-bdb9-370612011ed1 tempest-VolumesExtendTest-1015635940 None] Lock "cinder-50f2b399-3ba8-4fcb-a13a-3a8edd6a4cc1-delete_volume" released by "delete_volume" :: held 4.524s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:06:54 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:06:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Flow 'volume_create_manager' (7bd544df-8811-4bcd-90ef-210bbfd475f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:06:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97870a29-9579-424b-8b3e-d76714f2cf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97870a29-9579-424b-8b3e-d76714f2cf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1882074045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045d27ed-8b45-4f02-adae-b4bb33d1033b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00183ed97dc49108504123802f86e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:06:55Z,use_quota=True,user_id='82a171b886aa453cbf69599bec307061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9f2703-b905-4e10-81be-4906cfc3d561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb9f2703-b905-4e10-81be-4906cfc3d561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cebed6c-8b43-480b-97e4-631d67ca7e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cebed6c-8b43-480b-97e4-631d67ca7e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '045d27ed-8b45-4f02-adae-b4bb33d1033b', 'volume_name': 'volume-045d27ed-8b45-4f02-adae-b4bb33d1033b', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef08b293-0f0c-4d7d-b173-521f98d1917e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef08b293-0f0c-4d7d-b173-521f98d1917e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (788369a8-4eba-4f86-b800-f8b22988a36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:54 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Volume 045d27ed-8b45-4f02-adae-b4bb33d1033b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-045d27ed-8b45-4f02-adae-b4bb33d1033b', 'volume_size': 1} Jul 07 22:06:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:06:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:06:54 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1882074045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045d27ed-8b45-4f02-adae-b4bb33d1033b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00183ed97dc49108504123802f86e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:06:55Z,use_quota=True,user_id='82a171b886aa453cbf69599bec307061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:06:54 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Creating volume 045d27ed-8b45-4f02-adae-b4bb33d1033b {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:06:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:06:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:06:54 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:06:54 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:06:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:06:54 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:06:54 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:06:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:54 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b 1073741824 Jul 07 22:06:54 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Flow 'volume_create_manager' (eb15f06b-f6a7-4836-8867-76d7be1dfc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7bdb28-00c3-4195-9470-6d16d112fb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7bdb28-00c3-4195-9470-6d16d112fb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-587998283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636e8d06-b2fe-4b44-8f68-222311cf2303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6abafbf77604d9eaad0853cd00dcf5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:06:55Z,use_quota=True,user_id='63c75af720e84b70a4543e49a71344a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fc7837b-2126-41c1-8226-20549c80480d),volume_type_id=9fc7837b-2126-41c1-8226-20549c80480d)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (119e9cf3-b60c-4ee0-b87f-61a3c45772cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (119e9cf3-b60c-4ee0-b87f-61a3c45772cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8634d7d-839f-4b71-a4eb-cc9d758877ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8634d7d-839f-4b71-a4eb-cc9d758877ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '636e8d06-b2fe-4b44-8f68-222311cf2303', 'volume_name': 'volume-636e8d06-b2fe-4b44-8f68-222311cf2303', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db129c44-a372-419f-9f0c-3508f470ccbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db129c44-a372-419f-9f0c-3508f470ccbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f475bb2-f99e-48bd-9e01-9605fd6650c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:55 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Volume 636e8d06-b2fe-4b44-8f68-222311cf2303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-636e8d06-b2fe-4b44-8f68-222311cf2303', 'volume_size': 1} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Flow 'volume_create_manager' (2288bc1c-280e-4d7f-9aac-ab26052468f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb524648-0710-463d-b852-27fad0c88385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb524648-0710-463d-b852-27fad0c88385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1127219794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f31eac78-3b5d-4baa-9c29-6b32ef794521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6abafbf77604d9eaad0853cd00dcf5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:06:55Z,use_quota=True,user_id='63c75af720e84b70a4543e49a71344a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be470b2b-f5b0-4d2a-bf4c-86adc9a0b438),volume_type_id=be470b2b-f5b0-4d2a-bf4c-86adc9a0b438)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb80397-3a87-4683-8ca3-36742e843573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb80397-3a87-4683-8ca3-36742e843573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c1c478-57db-42c3-b15a-b38250ddcf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c1c478-57db-42c3-b15a-b38250ddcf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f31eac78-3b5d-4baa-9c29-6b32ef794521', 'volume_name': 'volume-f31eac78-3b5d-4baa-9c29-6b32ef794521', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f59e9fc-18ea-463d-99b4-1a3852f7815c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f59e9fc-18ea-463d-99b4-1a3852f7815c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f76d30b-2958-4ac1-aec7-7674d198429a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:55 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Volume f31eac78-3b5d-4baa-9c29-6b32ef794521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f31eac78-3b5d-4baa-9c29-6b32ef794521', 'volume_size': 1} Jul 07 22:06:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:06:56 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b 1073741824" returned: 0 in 1.521s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:56 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b Jul 07 22:06:56 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:56 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:06:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Flow 'volume_create_manager' (904fe8dc-2665-4bc4-a3a3-1d8a73de302e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:06:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10aee0d1-8ad1-4656-b3ab-3b775decf975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10aee0d1-8ad1-4656-b3ab-3b775decf975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce81f8cf-2a61-43d1-becb-25f0fcda9a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46466b44bd6d4bdb8961255f22e3923e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:06:57Z,use_quota=True,user_id='5719f831fa9e4fe298b60ae6c10c927a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d6b4fc-8dcd-4d53-b9e8-5b84b11ca384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d6b4fc-8dcd-4d53-b9e8-5b84b11ca384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8300465-f179-42ad-bb76-a3de4c8e090b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:56 devstack cinder-volume[87586]: DEBUG cinder.image.glance [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Creating Keystone auth plugin from conf {{(pid=87586) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Flow 'volume_create_manager' (515b714e-4270-4287-8d65-08790e4207ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7738eef-31a0-4d0a-8873-123fd1162de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7738eef-31a0-4d0a-8873-123fd1162de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1265079289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9574dd-6238-45c8-8d91-3d4768ccc28a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6abafbf77604d9eaad0853cd00dcf5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:06:57Z,use_quota=True,user_id='63c75af720e84b70a4543e49a71344a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(230e99b1-1b7f-4074-98c3-93455a5c9471),volume_type_id=230e99b1-1b7f-4074-98c3-93455a5c9471)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e340f03-10e5-4ebb-915d-7414343e6126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e340f03-10e5-4ebb-915d-7414343e6126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6b782c-a53c-4ab6-87ac-eddb33fc75c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.image.glance [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Creating Keystone auth plugin from conf {{(pid=87586) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8300465-f179-42ad-bb76-a3de4c8e090b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ce81f8cf-2a61-43d1-becb-25f0fcda9a51', 'volume_name': 'volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51', 'volume_size': 1, 'image_id': 'b79ab261-61b7-49e0-874d-a859c6f8cfe7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b79ab261-61b7-49e0-874d-a859c6f8cfe7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cdeaf0a88fb2abcc5df0b67a6b8f995e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '46466b44bd6d4bdb8961255f22e3923e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '923bc67651b2eb37a75d06ed2b7dac904c634201aafaa89d2dabc3e619b6ff06b8cef9c206c15cf2a8dea6957a561422d86a07f808bcd2f77dad1b548df560fe', 'id': 'b79ab261-61b7-49e0-874d-a859c6f8cfe7', 'created_at': datetime.datetime(2026, 7, 7, 20, 6, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 6, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b79ab261-61b7-49e0-874d-a859c6f8cfe7/file', 'properties': {}}, 'image_service': }' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e25d3f6e-b763-47e9-9d5a-a265f0977a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e25d3f6e-b763-47e9-9d5a-a265f0977a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e7d3552-1dd8-432e-8fd6-65472ff40e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:57 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Volume ce81f8cf-2a61-43d1-becb-25f0fcda9a51: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51', 'volume_size': 1, 'image_id': 'b79ab261-61b7-49e0-874d-a859c6f8cfe7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b79ab261-61b7-49e0-874d-a859c6f8cfe7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cdeaf0a88fb2abcc5df0b67a6b8f995e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '46466b44bd6d4bdb8961255f22e3923e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '923bc67651b2eb37a75d06ed2b7dac904c634201aafaa89d2dabc3e619b6ff06b8cef9c206c15cf2a8dea6957a561422d86a07f808bcd2f77dad1b548df560fe', 'id': 'b79ab261-61b7-49e0-874d-a859c6f8cfe7', 'created_at': datetime.datetime(2026, 7, 7, 20, 6, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 6, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b79ab261-61b7-49e0-874d-a859c6f8cfe7/file', 'properties': {}}, 'image_service': } Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Trying to clone ce81f8cf-2a61-43d1-becb-25f0fcda9a51 from image b79ab261-61b7-49e0-874d-a859c6f8cfe7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b79ab261-61b7-49e0-874d-a859c6f8cfe7', 'metadata': {}}]). {{(pid=87586) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:06:57 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Image download 0.00 MB at 0.00 MB/s Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea827bf-674a-400a-9ddb-5df046e99674]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6b782c-a53c-4ab6-87ac-eddb33fc75c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fd9574dd-6238-45c8-8d91-3d4768ccc28a', 'volume_name': 'volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a', 'volume_size': 1, 'image_id': '390a90e1-3cb4-4566-b9e7-d2e958f30403', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/390a90e1-3cb4-4566-b9e7-d2e958f30403', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--75260229', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6abafbf77604d9eaad0853cd00dcf5c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '390a90e1-3cb4-4566-b9e7-d2e958f30403', 'created_at': datetime.datetime(2026, 7, 7, 20, 6, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 6, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/390a90e1-3cb4-4566-b9e7-d2e958f30403/file', 'properties': {}}, 'image_service': }' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2edc6690-5107-4461-8f0d-dcf736d3dce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2edc6690-5107-4461-8f0d-dcf736d3dce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:57 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD Jul 07 22:06:57 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f0caf0-b17c-40b1-8853-2fb471adb096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:57 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Volume fd9574dd-6238-45c8-8d91-3d4768ccc28a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a', 'volume_size': 1, 'image_id': '390a90e1-3cb4-4566-b9e7-d2e958f30403', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/390a90e1-3cb4-4566-b9e7-d2e958f30403', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--75260229', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6abafbf77604d9eaad0853cd00dcf5c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '390a90e1-3cb4-4566-b9e7-d2e958f30403', 'created_at': datetime.datetime(2026, 7, 7, 20, 6, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 6, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/390a90e1-3cb4-4566-b9e7-d2e958f30403/file', 'properties': {}}, 'image_service': } Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Trying to clone fd9574dd-6238-45c8-8d91-3d4768ccc28a from image 390a90e1-3cb4-4566-b9e7-d2e958f30403 at location (None, [{'url': 'file:///opt/stack/data/glance/images/390a90e1-3cb4-4566-b9e7-d2e958f30403', 'metadata': {}}]). {{(pid=87586) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:06:57 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b" returned: 0 in 1.502s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] <== create_volume: return (3090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.094s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.653s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-587998283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636e8d06-b2fe-4b44-8f68-222311cf2303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6abafbf77604d9eaad0853cd00dcf5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:06:55Z,use_quota=True,user_id='63c75af720e84b70a4543e49a71344a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fc7837b-2126-41c1-8226-20549c80480d),volume_type_id=9fc7837b-2126-41c1-8226-20549c80480d)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Creating volume 636e8d06-b2fe-4b44-8f68-222311cf2303 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:06:57 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-636e8d06-b2fe-4b44-8f68-222311cf2303 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (788369a8-4eba-4f86-b800-f8b22988a36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-045d27ed-8b45-4f02-adae-b4bb33d1033b', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e7e259-4237-4d03-9b84-b18703e5deab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:06:57 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-636e8d06-b2fe-4b44-8f68-222311cf2303 1073741824 Jul 07 22:06:57 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:57 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Volume volume-045d27ed-8b45-4f02-adae-b4bb33d1033b (045d27ed-8b45-4f02-adae-b4bb33d1033b): created successfully Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e7e259-4237-4d03-9b84-b18703e5deab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:06:57 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Flow 'volume_create_manager' (7bd544df-8811-4bcd-90ef-210bbfd475f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:06:58 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-cdf41119-a78a-4df0-92fd-5201e70e6268 tempest-VolumesExtendTest-1015635940 None] Created volume successfully. Jul 07 22:06:58 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD" returned: 0 in 1.313s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:59 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD Jul 07 22:06:59 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e66b2876-1942-4480-b7b8-a9602c41b07b tempest-VolumesExtendTest-1015635940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:06:59 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-636e8d06-b2fe-4b44-8f68-222311cf2303 1073741824" returned: 0 in 1.338s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-636e8d06-b2fe-4b44-8f68-222311cf2303 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:06:59 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-636e8d06-b2fe-4b44-8f68-222311cf2303 Jul 07 22:06:59 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:06:59 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Jul 07 22:06:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD" returned: 1 in 1.120s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:06:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:06:59 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Temporary image b79ab261-61b7-49e0-874d-a859c6f8cfe7 is fetched for user 5719f831fa9e4fe298b60ae6c10c927a. {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:07:00 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8f1686-07f8-47ea-9bb0-480b18f1ae80]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:00 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD Jul 07 22:07:00 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:00 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-636e8d06-b2fe-4b44-8f68-222311cf2303" returned: 0 in 0.990s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] <== create_volume: return (2394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:07:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.397s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.615s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:07:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1127219794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f31eac78-3b5d-4baa-9c29-6b32ef794521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6abafbf77604d9eaad0853cd00dcf5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:06:55Z,use_quota=True,user_id='63c75af720e84b70a4543e49a71344a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be470b2b-f5b0-4d2a-bf4c-86adc9a0b438),volume_type_id=be470b2b-f5b0-4d2a-bf4c-86adc9a0b438)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:07:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Creating volume f31eac78-3b5d-4baa-9c29-6b32ef794521 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:07:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:07:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:07:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:07:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:07:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:07:00 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:07:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f31eac78-3b5d-4baa-9c29-6b32ef794521 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:00 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f31eac78-3b5d-4baa-9c29-6b32ef794521 1073741824 Jul 07 22:07:00 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f475bb2-f99e-48bd-9e01-9605fd6650c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-636e8d06-b2fe-4b44-8f68-222311cf2303', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f5b595-a7b1-4dfa-bece-62cfdc235168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:00 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Volume volume-636e8d06-b2fe-4b44-8f68-222311cf2303 (636e8d06-b2fe-4b44-8f68-222311cf2303): created successfully Jul 07 22:07:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f5b595-a7b1-4dfa-bece-62cfdc235168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Flow 'volume_create_manager' (eb15f06b-f6a7-4836-8867-76d7be1dfc4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:07:00 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-9d4ceb4c-aad8-40b9-ad59-ca0e099f4a8b tempest-TestInstancesWithCinderVolumes-1850946614 None] Created volume successfully. Jul 07 22:07:00 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD" returned: 0 in 0.925s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:01 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD Jul 07 22:07:01 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:01 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f31eac78-3b5d-4baa-9c29-6b32ef794521 1073741824" returned: 0 in 1.110s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f31eac78-3b5d-4baa-9c29-6b32ef794521 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:01 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f31eac78-3b5d-4baa-9c29-6b32ef794521 Jul 07 22:07:01 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:01 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD" returned: 1 in 0.867s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:07:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:07:02 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_390a90e1-3cb4-4566-b9e7-d2e958f30403_lyx2o0r5devstack@QuobyteHD, size 20.69 MB, duration 4.56 sec {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:07:02 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Image download 20.69 MB at 4.54 MB/s Jul 07 22:07:02 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[97843f7a-8c4f-46ab-82bc-8eaa173051d1]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_390a90e1-3cb4-4566-b9e7-d2e958f30403_lyx2o0r5devstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:02 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f31eac78-3b5d-4baa-9c29-6b32ef794521" returned: 0 in 0.761s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:07:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.950s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e66b2876-1942-4480-b7b8-a9602c41b07b tempest-VolumesExtendTest-1015635940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.055s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:07:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-e66b2876-1942-4480-b7b8-a9602c41b07b tempest-VolumesExtendTest-1015635940 None] Creating offline snapshot 44345b01-9e6c-4b67-99a5-0803d2b3e4c0 of volume 045d27ed-8b45-4f02-adae-b4bb33d1033b {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:07:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f76d30b-2958-4ac1-aec7-7674d198429a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f31eac78-3b5d-4baa-9c29-6b32ef794521', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63c38a2-2dfc-4e95-ab83-4c7f12fe6e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:02 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[476801ac-25e5-413d-9738-e2ad9f7840c1]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e66b2876-1942-4480-b7b8-a9602c41b07b tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:02 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Volume volume-f31eac78-3b5d-4baa-9c29-6b32ef794521 (f31eac78-3b5d-4baa-9c29-6b32ef794521): created successfully Jul 07 22:07:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63c38a2-2dfc-4e95-ab83-4c7f12fe6e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Flow 'volume_create_manager' (2288bc1c-280e-4d7f-9aac-ab26052468f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:07:02 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_390a90e1-3cb4-4566-b9e7-d2e958f30403_lyx2o0r5devstack@QuobyteHD Jul 07 22:07:02 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:02 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-a5b7818b-a14b-45ec-aa9e-729c2fcc5a3d tempest-TestInstancesWithCinderVolumes-1850946614 None] Created volume successfully. Jul 07 22:07:02 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b Jul 07 22:07:02 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:02 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:07:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Flow 'volume_create_manager' (b2664b20-0e77-4b27-a0b6-f1a7ece92ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:07:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e00232-057e-45ef-8bb7-282dc5b2c1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e00232-057e-45ef-8bb7-282dc5b2c1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-823830212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad930c78286b404ab994f50b55c5aaec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:07:03Z,use_quota=True,user_id='bd765b164840486fa4610859638f52c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81cfafa5-ae42-411a-938c-4f69d412818d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81cfafa5-ae42-411a-938c-4f69d412818d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db0217c-0c10-45b4-8306-006b6b5d187e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:02 devstack cinder-volume[87586]: DEBUG cinder.image.glance [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Creating Keystone auth plugin from conf {{(pid=87586) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:07:03 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_390a90e1-3cb4-4566-b9e7-d2e958f30403_lyx2o0r5devstack@QuobyteHD" returned: 0 in 0.821s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:03 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Temporary image 390a90e1-3cb4-4566-b9e7-d2e958f30403 is fetched for user 63c75af720e84b70a4543e49a71344a9. {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:07:03 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2039fe04-60e5-471c-9ad9-7d8a632eed31]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_390a90e1-3cb4-4566-b9e7-d2e958f30403_lyx2o0r5devstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:03 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e66b2876-1942-4480-b7b8-a9602c41b07b tempest-VolumesExtendTest-1015635940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b" returned: 0 in 0.848s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e66b2876-1942-4480-b7b8-a9602c41b07b tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.44345b01-9e6c-4b67-99a5-0803d2b3e4c0 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:03 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.44345b01-9e6c-4b67-99a5-0803d2b3e4c0 1G Jul 07 22:07:03 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db0217c-0c10-45b4-8306-006b6b5d187e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f', 'volume_name': 'volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f', 'volume_size': 1, 'image_id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '922c2d549e794c9ebc74bddfbafcb8e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'created_at': datetime.datetime(2026, 7, 7, 19, 46, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 19, 46, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b6386c-c936-4b52-a3a8-792e46aa51bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:03 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_390a90e1-3cb4-4566-b9e7-d2e958f30403_lyx2o0r5devstack@QuobyteHD Jul 07 22:07:03 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b6386c-c936-4b52-a3a8-792e46aa51bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816f4c28-cd26-4624-b83c-1c7b43edc412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:03 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Volume 6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f', 'volume_size': 1, 'image_id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '922c2d549e794c9ebc74bddfbafcb8e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'created_at': datetime.datetime(2026, 7, 7, 19, 46, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 19, 46, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 22:07:03 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Trying to clone 6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f from image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d at location (None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}]). {{(pid=87586) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:07:03 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_v__ebx7ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:07:03 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Image download 20.69 MB at 20.69 MB/s Jul 07 22:07:03 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c64fd25-93fa-4cab-b0e6-937dfc4b4d82]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_v__ebx7ydevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:03 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_v__ebx7ydevstack@QuobyteHD Jul 07 22:07:03 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:03 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_390a90e1-3cb4-4566-b9e7-d2e958f30403_lyx2o0r5devstack@QuobyteHD" returned: 0 in 0.821s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:07:04 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e66b2876-1942-4480-b7b8-a9602c41b07b tempest-VolumesExtendTest-1015635940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.44345b01-9e6c-4b67-99a5-0803d2b3e4c0 1G" returned: 0 in 0.907s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e66b2876-1942-4480-b7b8-a9602c41b07b tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-045d27ed-8b45-4f02-adae-b4bb33d1033b -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.44345b01-9e6c-4b67-99a5-0803d2b3e4c0 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:04 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-045d27ed-8b45-4f02-adae-b4bb33d1033b -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.44345b01-9e6c-4b67-99a5-0803d2b3e4c0 Jul 07 22:07:04 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:04 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_v__ebx7ydevstack@QuobyteHD" returned: 0 in 0.776s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:04 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Temporary image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d is fetched for user bd765b164840486fa4610859638f52c7. {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:07:04 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f477a0d-8361-49d1-8c34-f7db3ff0fa08]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_v__ebx7ydevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:04 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_v__ebx7ydevstack@QuobyteHD Jul 07 22:07:04 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:04 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e66b2876-1942-4480-b7b8-a9602c41b07b tempest-VolumesExtendTest-1015635940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-045d27ed-8b45-4f02-adae-b4bb33d1033b -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.44345b01-9e6c-4b67-99a5-0803d2b3e4c0" returned: 0 in 0.691s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:04 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-e66b2876-1942-4480-b7b8-a9602c41b07b tempest-VolumesExtendTest-1015635940 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.44345b01-9e6c-4b67-99a5-0803d2b3e4c0 is being set with open permissions: ugo+rw Jul 07 22:07:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e66b2876-1942-4480-b7b8-a9602c41b07b tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.44345b01-9e6c-4b67-99a5-0803d2b3e4c0 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:04 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.44345b01-9e6c-4b67-99a5-0803d2b3e4c0 Jul 07 22:07:04 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:05 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_v__ebx7ydevstack@QuobyteHD" returned: 0 in 0.750s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:07:05 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e66b2876-1942-4480-b7b8-a9602c41b07b tempest-VolumesExtendTest-1015635940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.44345b01-9e6c-4b67-99a5-0803d2b3e4c0" returned: 0 in 0.660s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e66b2876-1942-4480-b7b8-a9602c41b07b tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:05 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.info Jul 07 22:07:05 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:06 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e66b2876-1942-4480-b7b8-a9602c41b07b tempest-VolumesExtendTest-1015635940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.info" returned: 0 in 0.619s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:06 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-e66b2876-1942-4480-b7b8-a9602c41b07b tempest-VolumesExtendTest-1015635940 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.info is being set with open permissions: ugo+rw Jul 07 22:07:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e66b2876-1942-4480-b7b8-a9602c41b07b tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:06 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.info Jul 07 22:07:06 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:06 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e66b2876-1942-4480-b7b8-a9602c41b07b tempest-VolumesExtendTest-1015635940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.info" returned: 0 in 0.623s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e66b2876-1942-4480-b7b8-a9602c41b07b tempest-VolumesExtendTest-1015635940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.460s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.894s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:07:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce81f8cf-2a61-43d1-becb-25f0fcda9a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46466b44bd6d4bdb8961255f22e3923e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:06:57Z,use_quota=True,user_id='5719f831fa9e4fe298b60ae6c10c927a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:07:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Creating volume ce81f8cf-2a61-43d1-becb-25f0fcda9a51 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:07:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:07:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:07:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:07:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:07:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:07:06 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:07:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:06 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51 1073741824 Jul 07 22:07:06 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:06 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-e66b2876-1942-4480-b7b8-a9602c41b07b tempest-VolumesExtendTest-1015635940 None] Create snapshot completed successfully Jul 07 22:07:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aec1c43c-988a-4ce2-9389-0576b03ceb65 tempest-VolumesExtendTest-1015635940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:07:07 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51 1073741824" returned: 0 in 0.861s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:07 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51 Jul 07 22:07:07 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:08 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51" returned: 0 in 0.617s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:07:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.285s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:07:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1265079289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9574dd-6238-45c8-8d91-3d4768ccc28a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6abafbf77604d9eaad0853cd00dcf5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:06:57Z,use_quota=True,user_id='63c75af720e84b70a4543e49a71344a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(230e99b1-1b7f-4074-98c3-93455a5c9471),volume_type_id=230e99b1-1b7f-4074-98c3-93455a5c9471)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:07:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Creating volume fd9574dd-6238-45c8-8d91-3d4768ccc28a {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:07:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:07:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:07:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:07:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:07:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:07:08 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:07:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:08 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a 1073741824 Jul 07 22:07:08 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:08 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Attempting download of b79ab261-61b7-49e0-874d-a859c6f8cfe7 ((None, [{'url': 'file:///opt/stack/data/glance/images/b79ab261-61b7-49e0-874d-a859c6f8cfe7', 'metadata': {}}])) to volume ce81f8cf-2a61-43d1-becb-25f0fcda9a51. {{(pid=87586) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:07:08 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d50194d-e1c9-42ce-bbd8-c9c0db25b29f]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b79ab261-61b7-49e0-874d-a859c6f8cfe7_g3z092eg {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:08 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b79ab261-61b7-49e0-874d-a859c6f8cfe7_g3z092eg Jul 07 22:07:08 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:09 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a 1073741824" returned: 0 in 0.809s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:09 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b79ab261-61b7-49e0-874d-a859c6f8cfe7_g3z092eg" returned: 0 in 0.742s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b79ab261-61b7-49e0-874d-a859c6f8cfe7_g3z092eg {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:09 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a Jul 07 22:07:09 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:09 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b79ab261-61b7-49e0-874d-a859c6f8cfe7_g3z092eg Jul 07 22:07:09 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:09 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a" returned: 0 in 0.658s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.498s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-823830212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad930c78286b404ab994f50b55c5aaec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:07:03Z,use_quota=True,user_id='bd765b164840486fa4610859638f52c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Creating volume 6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:07:09 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:09 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f 1073741824 Jul 07 22:07:09 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Attempting download of 390a90e1-3cb4-4566-b9e7-d2e958f30403 ((None, [{'url': 'file:///opt/stack/data/glance/images/390a90e1-3cb4-4566-b9e7-d2e958f30403', 'metadata': {}}])) to volume fd9574dd-6238-45c8-8d91-3d4768ccc28a. {{(pid=87586) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:07:09 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b79ab261-61b7-49e0-874d-a859c6f8cfe7_g3z092eg" returned: 1 in 0.746s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b79ab261-61b7-49e0-874d-a859c6f8cfe7_g3z092eg' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[10aaab6a-81f0-48b2-8b9b-c22c0e93ce85]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0411455c-bb92-435f-b68a-628a8df12e9f]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_390a90e1-3cb4-4566-b9e7-d2e958f30403_kik7pzj2 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:09 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD Jul 07 22:07:09 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:09 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_390a90e1-3cb4-4566-b9e7-d2e958f30403_kik7pzj2 Jul 07 22:07:09 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:10 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD" returned: 0 in 0.766s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:10 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_390a90e1-3cb4-4566-b9e7-d2e958f30403_kik7pzj2" returned: 0 in 0.774s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_390a90e1-3cb4-4566-b9e7-d2e958f30403_kik7pzj2 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:10 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f 1073741824" returned: 0 in 0.938s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:10 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD Jul 07 22:07:10 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:10 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_390a90e1-3cb4-4566-b9e7-d2e958f30403_kik7pzj2 Jul 07 22:07:10 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:10 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f Jul 07 22:07:10 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:11 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_390a90e1-3cb4-4566-b9e7-d2e958f30403_kik7pzj2" returned: 1 in 0.727s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_390a90e1-3cb4-4566-b9e7-d2e958f30403_kik7pzj2' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:07:11 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ac72c3-de51-49a6-be21-aa37b4d56fa0]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_390a90e1-3cb4-4566-b9e7-d2e958f30403_lyx2o0r5devstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:11 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD" returned: 1 in 0.798s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:07:11 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] b79ab261-61b7-49e0-874d-a859c6f8cfe7 was raw, converting to raw {{(pid=87586) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:07:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:11 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51 Jul 07 22:07:11 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:11 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f" returned: 0 in 0.685s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:11 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:07:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aec1c43c-988a-4ce2-9389-0576b03ceb65 tempest-VolumesExtendTest-1015635940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 4.070s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:07:11 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bce93ff-f442-4fb0-8faf-a121275ca503]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aec1c43c-988a-4ce2-9389-0576b03ceb65 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:11 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_390a90e1-3cb4-4566-b9e7-d2e958f30403_lyx2o0r5devstack@QuobyteHD Jul 07 22:07:11 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:11 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Attempting download of 3ab6a905-2c25-4ca7-8034-1de3dbd6512d ((None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}])) to volume 6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f. {{(pid=87586) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:07:11 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ef7ab6-435c-4998-8025-23ffb2feeeb7]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_wfhedyid {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:11 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b Jul 07 22:07:11 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:11 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_wfhedyid Jul 07 22:07:11 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:12 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_390a90e1-3cb4-4566-b9e7-d2e958f30403_lyx2o0r5devstack@QuobyteHD" returned: 0 in 0.891s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:12 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:12 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] 390a90e1-3cb4-4566-b9e7-d2e958f30403 was qcow2, converting to raw {{(pid=87586) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:07:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_390a90e1-3cb4-4566-b9e7-d2e958f30403_lyx2o0r5devstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51" returned: 0 in 0.890s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:12 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b79ab261-61b7-49e0-874d-a859c6f8cfe7_9ckp5g4ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51 {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:07:12 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 22:07:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:12 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_390a90e1-3cb4-4566-b9e7-d2e958f30403_lyx2o0r5devstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a Jul 07 22:07:12 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:12 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51 1G Jul 07 22:07:12 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:12 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aec1c43c-988a-4ce2-9389-0576b03ceb65 tempest-VolumesExtendTest-1015635940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b" returned: 0 in 0.946s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aec1c43c-988a-4ce2-9389-0576b03ceb65 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.44345b01-9e6c-4b67-99a5-0803d2b3e4c0 2G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:12 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_wfhedyid" returned: 0 in 0.855s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_wfhedyid {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:12 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_wfhedyid Jul 07 22:07:12 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aec1c43c-988a-4ce2-9389-0576b03ceb65 tempest-VolumesExtendTest-1015635940 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.44345b01-9e6c-4b67-99a5-0803d2b3e4c0 2G" returned: 0 in 0.169s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aec1c43c-988a-4ce2-9389-0576b03ceb65 tempest-VolumesExtendTest-1015635940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.163s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:12 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-aec1c43c-988a-4ce2-9389-0576b03ceb65 tempest-VolumesExtendTest-1015635940 None] Extend volume completed successfully. Jul 07 22:07:12 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3f782a40-cfd7-4e74-abae-4bc02c003cf6 tempest-VolumesExtendTest-1015635940 None] Acquiring lock "cinder-44345b01-9e6c-4b67-99a5-0803d2b3e4c0-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:07:12 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3f782a40-cfd7-4e74-abae-4bc02c003cf6 tempest-VolumesExtendTest-1015635940 None] Lock "cinder-44345b01-9e6c-4b67-99a5-0803d2b3e4c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:07:12 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3f782a40-cfd7-4e74-abae-4bc02c003cf6 tempest-VolumesExtendTest-1015635940 None] Acquiring lock "cinder-quobyte-045d27ed-8b45-4f02-adae-b4bb33d1033b" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:07:12 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3f782a40-cfd7-4e74-abae-4bc02c003cf6 tempest-VolumesExtendTest-1015635940 None] Lock "cinder-quobyte-045d27ed-8b45-4f02-adae-b4bb33d1033b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:07:12 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3f782a40-cfd7-4e74-abae-4bc02c003cf6 tempest-VolumesExtendTest-1015635940 None] Acquiring lock "cinder-quobyte-44345b01-9e6c-4b67-99a5-0803d2b3e4c0" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:07:12 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3f782a40-cfd7-4e74-abae-4bc02c003cf6 tempest-VolumesExtendTest-1015635940 None] Lock "cinder-quobyte-44345b01-9e6c-4b67-99a5-0803d2b3e4c0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:07:12 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-3f782a40-cfd7-4e74-abae-4bc02c003cf6 tempest-VolumesExtendTest-1015635940 None] Deleting offline snapshot 44345b01-9e6c-4b67-99a5-0803d2b3e4c0 of volume 045d27ed-8b45-4f02-adae-b4bb33d1033b {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:07:12 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-3f782a40-cfd7-4e74-abae-4bc02c003cf6 tempest-VolumesExtendTest-1015635940 None] snapshot_file for this snap is: volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.44345b01-9e6c-4b67-99a5-0803d2b3e4c0 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:07:12 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8fd1a4-6bcc-4721-be92-ec4c3e4a6d59]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3f782a40-cfd7-4e74-abae-4bc02c003cf6 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.44345b01-9e6c-4b67-99a5-0803d2b3e4c0 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:13 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.44345b01-9e6c-4b67-99a5-0803d2b3e4c0 Jul 07 22:07:13 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:13 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51 1G" returned: 0 in 0.845s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:13 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[409901f5-03d6-4242-b287-a3534fd1d65b]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:13 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51 Jul 07 22:07:13 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:13 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_wfhedyid" returned: 1 in 0.933s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_wfhedyid' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:07:13 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb8874d-82d4-4fda-8661-0e43ddc62534]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_v__ebx7ydevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:13 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_v__ebx7ydevstack@QuobyteHD Jul 07 22:07:13 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:13 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3f782a40-cfd7-4e74-abae-4bc02c003cf6 tempest-VolumesExtendTest-1015635940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.44345b01-9e6c-4b67-99a5-0803d2b3e4c0" returned: 0 in 0.866s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-3f782a40-cfd7-4e74-abae-4bc02c003cf6 tempest-VolumesExtendTest-1015635940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-045d27ed-8b45-4f02-adae-b4bb33d1033b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:07:13 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[921587f4-bbc6-4471-bdfc-e2c8a9e00920]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3f782a40-cfd7-4e74-abae-4bc02c003cf6 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:14 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51" returned: 0 in 0.851s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:14 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b Jul 07 22:07:14 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:14 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51 Jul 07 22:07:14 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:14 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_v__ebx7ydevstack@QuobyteHD" returned: 0 in 1.012s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:14 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] 3ab6a905-2c25-4ca7-8034-1de3dbd6512d was qcow2, converting to raw {{(pid=87586) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:07:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_v__ebx7ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:14 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_v__ebx7ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f Jul 07 22:07:14 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:14 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_390a90e1-3cb4-4566-b9e7-d2e958f30403_lyx2o0r5devstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a" returned: 0 in 2.393s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:14 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_390a90e1-3cb4-4566-b9e7-d2e958f30403_lyx2o0r5devstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:07:14 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Converted 112.00 MB image at 46.77 MB/s Jul 07 22:07:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:14 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a 1G Jul 07 22:07:14 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:14 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3f782a40-cfd7-4e74-abae-4bc02c003cf6 tempest-VolumesExtendTest-1015635940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b" returned: 0 in 0.882s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3f782a40-cfd7-4e74-abae-4bc02c003cf6 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.44345b01-9e6c-4b67-99a5-0803d2b3e4c0 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:14 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.44345b01-9e6c-4b67-99a5-0803d2b3e4c0 Jul 07 22:07:14 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:15 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51" returned: 1 in 0.984s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:07:15 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Downloaded image b79ab261-61b7-49e0-874d-a859c6f8cfe7 ((None, [{'url': 'file:///opt/stack/data/glance/images/b79ab261-61b7-49e0-874d-a859c6f8cfe7', 'metadata': {}}])) to volume ce81f8cf-2a61-43d1-becb-25f0fcda9a51 successfully. {{(pid=87586) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:07:15 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Temporary image b79ab261-61b7-49e0-874d-a859c6f8cfe7 for user 5719f831fa9e4fe298b60ae6c10c927a is deleted. {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:07:15 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Marking volume ce81f8cf-2a61-43d1-becb-25f0fcda9a51 as bootable. {{(pid=87586) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:07:15 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Copying metadata from image b79ab261-61b7-49e0-874d-a859c6f8cfe7 to ce81f8cf-2a61-43d1-becb-25f0fcda9a51. {{(pid=87586) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:07:15 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Creating volume glance metadata for volume ce81f8cf-2a61-43d1-becb-25f0fcda9a51 backed by image b79ab261-61b7-49e0-874d-a859c6f8cfe7 with: {'image_id': 'b79ab261-61b7-49e0-874d-a859c6f8cfe7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'cdeaf0a88fb2abcc5df0b67a6b8f995e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87586) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:07:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e7d3552-1dd8-432e-8fd6-65472ff40e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51', 'volume_size': 1, 'image_id': 'b79ab261-61b7-49e0-874d-a859c6f8cfe7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b79ab261-61b7-49e0-874d-a859c6f8cfe7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cdeaf0a88fb2abcc5df0b67a6b8f995e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '46466b44bd6d4bdb8961255f22e3923e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '923bc67651b2eb37a75d06ed2b7dac904c634201aafaa89d2dabc3e619b6ff06b8cef9c206c15cf2a8dea6957a561422d86a07f808bcd2f77dad1b548df560fe', 'id': 'b79ab261-61b7-49e0-874d-a859c6f8cfe7', 'created_at': datetime.datetime(2026, 7, 7, 20, 6, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 6, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b79ab261-61b7-49e0-874d-a859c6f8cfe7/file', 'properties': {}}, 'image_service': }' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98791a4c-7f80-4be4-8ca1-926d8abfdf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:15 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Volume volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51 (ce81f8cf-2a61-43d1-becb-25f0fcda9a51): created successfully Jul 07 22:07:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98791a4c-7f80-4be4-8ca1-926d8abfdf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Flow 'volume_create_manager' (904fe8dc-2665-4bc4-a3a3-1d8a73de302e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:07:15 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-97f9f79e-1369-4472-bcd3-d473413d2e6a tempest-VolumeImageDependencyTests-1534033662 None] Created volume successfully. Jul 07 22:07:15 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a 1G" returned: 0 in 0.860s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:15 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f034af60-6695-443e-9c6b-783516daf363]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:15 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a Jul 07 22:07:15 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:15 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3f782a40-cfd7-4e74-abae-4bc02c003cf6 tempest-VolumesExtendTest-1015635940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.44345b01-9e6c-4b67-99a5-0803d2b3e4c0" returned: 0 in 0.949s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3f782a40-cfd7-4e74-abae-4bc02c003cf6 tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.44345b01-9e6c-4b67-99a5-0803d2b3e4c0 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:15 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.44345b01-9e6c-4b67-99a5-0803d2b3e4c0 Jul 07 22:07:15 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] Acquiring lock "cinder-ce81f8cf-2a61-43d1-becb-25f0fcda9a51-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:07:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] Lock "cinder-ce81f8cf-2a61-43d1-becb-25f0fcda9a51-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:07:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] Acquiring lock "cinder-quobyte-ce81f8cf-2a61-43d1-becb-25f0fcda9a51" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:07:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] Lock "cinder-quobyte-ce81f8cf-2a61-43d1-becb-25f0fcda9a51" acquired by "delete_volume" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:07:16 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5df97c-c2e3-4567-b190-45cfa7753b1d]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:16 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51 Jul 07 22:07:16 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:16 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3f782a40-cfd7-4e74-abae-4bc02c003cf6 tempest-VolumesExtendTest-1015635940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b.44345b01-9e6c-4b67-99a5-0803d2b3e4c0" returned: 0 in 0.740s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3f782a40-cfd7-4e74-abae-4bc02c003cf6 tempest-VolumesExtendTest-1015635940 None] Lock "cinder-quobyte-44345b01-9e6c-4b67-99a5-0803d2b3e4c0" released by "_delete_snapshot" :: held 3.580s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:07:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3f782a40-cfd7-4e74-abae-4bc02c003cf6 tempest-VolumesExtendTest-1015635940 None] Lock "cinder-quobyte-045d27ed-8b45-4f02-adae-b4bb33d1033b" released by "delete_snapshot" :: held 3.609s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:07:16 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a" returned: 0 in 0.988s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:16 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_v__ebx7ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f" returned: 0 in 2.173s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:16 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3ab6a905-2c25-4ca7-8034-1de3dbd6512d_v__ebx7ydevstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:07:16 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Converted 112.00 MB image at 51.52 MB/s Jul 07 22:07:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:16 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f 1G Jul 07 22:07:16 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:16 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-3f782a40-cfd7-4e74-abae-4bc02c003cf6 tempest-VolumesExtendTest-1015635940 None] Created reservations ['3f9694ad-af6e-4804-b459-e47c8cd840ea', 'f8c8cd70-1536-418c-b28e-2b318aa9ae4b', '76f84f8d-e146-441b-83c2-2730e44dfe38', 'c936f235-51c5-4500-aa0f-9669d57e2cc9'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:07:16 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a Jul 07 22:07:16 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:16 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-3f782a40-cfd7-4e74-abae-4bc02c003cf6 tempest-VolumesExtendTest-1015635940 None] Delete snapshot completed successfully. Jul 07 22:07:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3f782a40-cfd7-4e74-abae-4bc02c003cf6 tempest-VolumesExtendTest-1015635940 None] Lock "cinder-44345b01-9e6c-4b67-99a5-0803d2b3e4c0-delete_snapshot" released by "delete_snapshot" :: held 3.838s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:07:17 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51" returned: 0 in 0.819s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:17 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51 Jul 07 22:07:17 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9a2baede-38c7-4552-bc64-46911c6b37cd tempest-VolumesExtendTest-1015635940 None] Acquiring lock "cinder-045d27ed-8b45-4f02-adae-b4bb33d1033b-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9a2baede-38c7-4552-bc64-46911c6b37cd tempest-VolumesExtendTest-1015635940 None] Lock "cinder-045d27ed-8b45-4f02-adae-b4bb33d1033b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:07:17 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a" returned: 1 in 0.817s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Downloaded image 390a90e1-3cb4-4566-b9e7-d2e958f30403 ((None, [{'url': 'file:///opt/stack/data/glance/images/390a90e1-3cb4-4566-b9e7-d2e958f30403', 'metadata': {}}])) to volume fd9574dd-6238-45c8-8d91-3d4768ccc28a successfully. {{(pid=87586) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Temporary image 390a90e1-3cb4-4566-b9e7-d2e958f30403 for user 63c75af720e84b70a4543e49a71344a9 is deleted. {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Marking volume fd9574dd-6238-45c8-8d91-3d4768ccc28a as bootable. {{(pid=87586) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:07:17 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f 1G" returned: 0 in 0.821s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Copying metadata from image 390a90e1-3cb4-4566-b9e7-d2e958f30403 to fd9574dd-6238-45c8-8d91-3d4768ccc28a. {{(pid=87586) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Creating volume glance metadata for volume fd9574dd-6238-45c8-8d91-3d4768ccc28a backed by image 390a90e1-3cb4-4566-b9e7-d2e958f30403 with: {'image_id': '390a90e1-3cb4-4566-b9e7-d2e958f30403', 'image_name': 'tempest-scenario-img--75260229', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87586) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9a2baede-38c7-4552-bc64-46911c6b37cd tempest-VolumesExtendTest-1015635940 None] Acquiring lock "cinder-quobyte-045d27ed-8b45-4f02-adae-b4bb33d1033b" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9a2baede-38c7-4552-bc64-46911c6b37cd tempest-VolumesExtendTest-1015635940 None] Lock "cinder-quobyte-045d27ed-8b45-4f02-adae-b4bb33d1033b" acquired by "delete_volume" :: waited 0.018s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[203c753a-38e5-4070-924f-3335a7f5ee6c]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4016521-54d8-4761-a745-44f33655ee61]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9a2baede-38c7-4552-bc64-46911c6b37cd tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f0caf0-b17c-40b1-8853-2fb471adb096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a', 'volume_size': 1, 'image_id': '390a90e1-3cb4-4566-b9e7-d2e958f30403', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/390a90e1-3cb4-4566-b9e7-d2e958f30403', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--75260229', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6abafbf77604d9eaad0853cd00dcf5c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '390a90e1-3cb4-4566-b9e7-d2e958f30403', 'created_at': datetime.datetime(2026, 7, 7, 20, 6, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 6, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/390a90e1-3cb4-4566-b9e7-d2e958f30403/file', 'properties': {}}, 'image_service': }' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261e3f92-b998-401e-adbf-4c3cf6d01b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:17 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Volume volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a (fd9574dd-6238-45c8-8d91-3d4768ccc28a): created successfully Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261e3f92-b998-401e-adbf-4c3cf6d01b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:17 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f Jul 07 22:07:17 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Flow 'volume_create_manager' (515b714e-4270-4287-8d65-08790e4207ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:07:17 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-23ebd552-3020-4f6d-b422-89d8ad89603a tempest-TestInstancesWithCinderVolumes-1850946614 None] Created volume successfully. Jul 07 22:07:17 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b Jul 07 22:07:17 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:17 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51" returned: 1 in 0.917s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:07:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:17 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51 Jul 07 22:07:17 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:18 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f" returned: 0 in 0.770s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:18 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f Jul 07 22:07:18 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:18 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9a2baede-38c7-4552-bc64-46911c6b37cd tempest-VolumesExtendTest-1015635940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b" returned: 0 in 0.914s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9a2baede-38c7-4552-bc64-46911c6b37cd tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:18 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b Jul 07 22:07:18 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:18 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce81f8cf-2a61-43d1-becb-25f0fcda9a51" returned: 0 in 0.738s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] Lock "cinder-quobyte-ce81f8cf-2a61-43d1-becb-25f0fcda9a51" released by "delete_volume" :: held 2.543s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:07:18 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] Created reservations ['cd770a18-da0e-43e2-8d9f-b67745032c53', '9d337ade-853e-480f-95f2-a33436e5334b', '98de5168-51d2-4dfa-93b0-ca06f50d3eba', 'a062be0e-1e3c-4df1-b9e4-153891fb2763'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:07:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:07:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:07:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:07:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:07:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:18 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:07:18 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:19 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f" returned: 1 in 0.938s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Downloaded image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d ((None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}])) to volume 6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f successfully. {{(pid=87586) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Temporary image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d for user bd765b164840486fa4610859638f52c7 is deleted. {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Marking volume 6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f as bootable. {{(pid=87586) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:07:19 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9a2baede-38c7-4552-bc64-46911c6b37cd tempest-VolumesExtendTest-1015635940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-045d27ed-8b45-4f02-adae-b4bb33d1033b" returned: 0 in 0.799s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Copying metadata from image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d to 6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f. {{(pid=87586) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Creating volume glance metadata for volume 6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f backed by image 3ab6a905-2c25-4ca7-8034-1de3dbd6512d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87586) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9a2baede-38c7-4552-bc64-46911c6b37cd tempest-VolumesExtendTest-1015635940 None] Lock "cinder-quobyte-045d27ed-8b45-4f02-adae-b4bb33d1033b" released by "delete_volume" :: held 1.792s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-9a2baede-38c7-4552-bc64-46911c6b37cd tempest-VolumesExtendTest-1015635940 None] Created reservations ['fc384c1f-9041-418b-8075-44e31fc98f6b', '18fcde49-5612-4eb4-9771-c2653176928b', '26f69c1d-6a74-433c-9a5c-92e57ec2597c', 'c85b77d2-bcb8-4ca2-9917-7f7278da6823'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816f4c28-cd26-4624-b83c-1c7b43edc412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f', 'volume_size': 1, 'image_id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '922c2d549e794c9ebc74bddfbafcb8e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3ab6a905-2c25-4ca7-8034-1de3dbd6512d', 'created_at': datetime.datetime(2026, 7, 7, 19, 46, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 19, 46, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3ab6a905-2c25-4ca7-8034-1de3dbd6512d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856740ed-4b2e-4b40-b2e4-3343ce15800a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:19 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Volume volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f (6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f): created successfully Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856740ed-4b2e-4b40-b2e4-3343ce15800a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Flow 'volume_create_manager' (b2664b20-0e77-4b27-a0b6-f1a7ece92ba1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:07:19 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-f1b45ca8-c3c5-4df7-80d2-22c44e768d07 tempest-TestShelveInstance-1408016595 None] Created volume successfully. Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9a2baede-38c7-4552-bc64-46911c6b37cd tempest-VolumesExtendTest-1015635940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9a2baede-38c7-4552-bc64-46911c6b37cd tempest-VolumesExtendTest-1015635940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9a2baede-38c7-4552-bc64-46911c6b37cd tempest-VolumesExtendTest-1015635940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9a2baede-38c7-4552-bc64-46911c6b37cd tempest-VolumesExtendTest-1015635940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9a2baede-38c7-4552-bc64-46911c6b37cd tempest-VolumesExtendTest-1015635940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9a2baede-38c7-4552-bc64-46911c6b37cd tempest-VolumesExtendTest-1015635940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:19 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:07:19 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:19 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.860s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:07:19 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] Deleted volume successfully. Jul 07 22:07:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ac69bb58-c9e7-430b-8712-ee2cf0e479ec tempest-VolumeImageDependencyTests-1534033662 None] Lock "cinder-ce81f8cf-2a61-43d1-becb-25f0fcda9a51-delete_volume" released by "delete_volume" :: held 3.701s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:07:20 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9a2baede-38c7-4552-bc64-46911c6b37cd tempest-VolumesExtendTest-1015635940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.914s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:20 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-9a2baede-38c7-4552-bc64-46911c6b37cd tempest-VolumesExtendTest-1015635940 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:07:20 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-9a2baede-38c7-4552-bc64-46911c6b37cd tempest-VolumesExtendTest-1015635940 None] Deleted volume successfully. Jul 07 22:07:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9a2baede-38c7-4552-bc64-46911c6b37cd tempest-VolumesExtendTest-1015635940 None] Lock "cinder-045d27ed-8b45-4f02-adae-b4bb33d1033b-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Flow 'volume_create_manager' (ff7fd375-5b07-405f-81cc-861c90b20794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1552212a-608d-4b14-b865-d771476ea460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1552212a-608d-4b14-b865-d771476ea460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1547049536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edba5559-56d0-425a-a366-d814ea7a8bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f380a523f647b9ad5c054ba06b8bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:07:24Z,use_quota=True,user_id='eaa233d8da324614b98c6cd7f5ed8a71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce12862-6490-42e4-a5d7-671927e68559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce12862-6490-42e4-a5d7-671927e68559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc4404a-3ba5-4008-b8ff-64ab6b1a6648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc4404a-3ba5-4008-b8ff-64ab6b1a6648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edba5559-56d0-425a-a366-d814ea7a8bdb', 'volume_name': 'volume-edba5559-56d0-425a-a366-d814ea7a8bdb', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761c3b79-ba1a-49ec-a51a-71eea52d043b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761c3b79-ba1a-49ec-a51a-71eea52d043b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a76b64b3-d74c-4d67-8c9a-88d9a5faa614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:24 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Volume edba5559-56d0-425a-a366-d814ea7a8bdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edba5559-56d0-425a-a366-d814ea7a8bdb', 'volume_size': 1} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1547049536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edba5559-56d0-425a-a366-d814ea7a8bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f380a523f647b9ad5c054ba06b8bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:07:24Z,use_quota=True,user_id='eaa233d8da324614b98c6cd7f5ed8a71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Creating volume edba5559-56d0-425a-a366-d814ea7a8bdb {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:07:24 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-edba5559-56d0-425a-a366-d814ea7a8bdb 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:24 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-edba5559-56d0-425a-a366-d814ea7a8bdb 1073741824 Jul 07 22:07:24 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Flow 'volume_create_manager' (140730b9-7e66-4c93-a38a-c9815423cf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355388ef-d8a0-49f3-ace3-a9496a0ac734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355388ef-d8a0-49f3-ace3-a9496a0ac734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-964427365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0919be1-4d70-49aa-841a-6182962df971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb6e36e79af54aafa58fc26e0a4b7884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:07:25Z,use_quota=True,user_id='bea8ec22f8444cbea14c533b1cbe7c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c23f0740-0dcb-49cd-aa77-ff147f18bbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c23f0740-0dcb-49cd-aa77-ff147f18bbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab45480c-e5cc-41a6-acb0-5f84d52db0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab45480c-e5cc-41a6-acb0-5f84d52db0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0919be1-4d70-49aa-841a-6182962df971', 'volume_name': 'volume-b0919be1-4d70-49aa-841a-6182962df971', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d0f332-2077-439f-baf1-11100f62eb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d0f332-2077-439f-baf1-11100f62eb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c3a43a-ff4e-404a-89f1-7058d7349dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:24 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Volume b0919be1-4d70-49aa-841a-6182962df971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0919be1-4d70-49aa-841a-6182962df971', 'volume_size': 1} Jul 07 22:07:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:07:25 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-edba5559-56d0-425a-a366-d814ea7a8bdb 1073741824" returned: 0 in 1.009s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-edba5559-56d0-425a-a366-d814ea7a8bdb {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:25 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-edba5559-56d0-425a-a366-d814ea7a8bdb Jul 07 22:07:25 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:26 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-edba5559-56d0-425a-a366-d814ea7a8bdb" returned: 0 in 0.716s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:07:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.558s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:07:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-964427365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0919be1-4d70-49aa-841a-6182962df971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb6e36e79af54aafa58fc26e0a4b7884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:07:25Z,use_quota=True,user_id='bea8ec22f8444cbea14c533b1cbe7c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:07:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Creating volume b0919be1-4d70-49aa-841a-6182962df971 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:07:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:07:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:07:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:07:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:07:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:07:26 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:07:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b0919be1-4d70-49aa-841a-6182962df971 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a76b64b3-d74c-4d67-8c9a-88d9a5faa614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edba5559-56d0-425a-a366-d814ea7a8bdb', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:26 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b0919be1-4d70-49aa-841a-6182962df971 1073741824 Jul 07 22:07:26 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6e948b-3d47-4a56-8803-38018a605497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-3549be66-e6f2-4053-bead-40c57abf758f req-028709f8-f843-476d-b37d-fc39489ea38b tempest-TestInstancesWithCinderVolumes-1850946614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:07:26 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Volume volume-edba5559-56d0-425a-a366-d814ea7a8bdb (edba5559-56d0-425a-a366-d814ea7a8bdb): created successfully Jul 07 22:07:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6e948b-3d47-4a56-8803-38018a605497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Flow 'volume_create_manager' (ff7fd375-5b07-405f-81cc-861c90b20794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:07:26 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-09cf98dc-0fb4-471a-b1fd-66bd166c7b7c tempest-VolumesNegativeTest-1597862322 None] Created volume successfully. Jul 07 22:07:27 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b0919be1-4d70-49aa-841a-6182962df971 1073741824" returned: 0 in 1.001s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b0919be1-4d70-49aa-841a-6182962df971 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:27 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b0919be1-4d70-49aa-841a-6182962df971 Jul 07 22:07:27 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:28 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b0919be1-4d70-49aa-841a-6182962df971" returned: 0 in 0.939s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] <== create_volume: return (1983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:07:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-3549be66-e6f2-4053-bead-40c57abf758f req-028709f8-f843-476d-b37d-fc39489ea38b tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.935s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:07:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c3a43a-ff4e-404a-89f1-7058d7349dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0919be1-4d70-49aa-841a-6182962df971', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7274787e-a210-4aff-9052-47b9cac1b625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:28 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1baf56ec-e207-4d57-9d8c-0aba2597120a]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-3549be66-e6f2-4053-bead-40c57abf758f req-028709f8-f843-476d-b37d-fc39489ea38b tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:28 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Volume volume-b0919be1-4d70-49aa-841a-6182962df971 (b0919be1-4d70-49aa-841a-6182962df971): created successfully Jul 07 22:07:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7274787e-a210-4aff-9052-47b9cac1b625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Flow 'volume_create_manager' (140730b9-7e66-4c93-a38a-c9815423cf32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:07:28 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-cad48768-b23f-4b9e-a53a-a6ad0eb42da2 tempest-ProjectReaderTests-698185307 None] Created volume successfully. Jul 07 22:07:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-4549c202-ed9b-42c7-9e24-0cd9856457fb req-382c14f1-df29-4b33-ac96-ea3e7bcd45b6 tempest-TestShelveInstance-1408016595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:07:28 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a Jul 07 22:07:28 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:29 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-3549be66-e6f2-4053-bead-40c57abf758f req-028709f8-f843-476d-b37d-fc39489ea38b tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a" returned: 0 in 1.076s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-3549be66-e6f2-4053-bead-40c57abf758f req-028709f8-f843-476d-b37d-fc39489ea38b tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:29 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a Jul 07 22:07:29 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:30 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-3549be66-e6f2-4053-bead-40c57abf758f req-028709f8-f843-476d-b37d-fc39489ea38b tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a" returned: 1 in 0.889s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-3549be66-e6f2-4053-bead-40c57abf758f req-028709f8-f843-476d-b37d-fc39489ea38b tempest-TestInstancesWithCinderVolumes-1850946614 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:07:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-3549be66-e6f2-4053-bead-40c57abf758f req-028709f8-f843-476d-b37d-fc39489ea38b tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.046s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-4549c202-ed9b-42c7-9e24-0cd9856457fb req-382c14f1-df29-4b33-ac96-ea3e7bcd45b6 tempest-TestShelveInstance-1408016595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.806s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:07:30 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3156ce-49c4-43d2-8627-dd41e9b3a22c]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-4549c202-ed9b-42c7-9e24-0cd9856457fb req-382c14f1-df29-4b33-ac96-ea3e7bcd45b6 tempest-TestShelveInstance-1408016595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-3549be66-e6f2-4053-bead-40c57abf758f req-028709f8-f843-476d-b37d-fc39489ea38b tempest-TestInstancesWithCinderVolumes-1850946614 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491', 'name': 'volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fcbc74c0-e1ee-4a66-9f18-13c47a891da5', 'enforce_multipath': True} {{(pid=87586) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4930}} Jul 07 22:07:30 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-3549be66-e6f2-4053-bead-40c57abf758f req-028709f8-f843-476d-b37d-fc39489ea38b tempest-TestInstancesWithCinderVolumes-1850946614 None] attachment_update completed successfully. Jul 07 22:07:30 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f Jul 07 22:07:30 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6387af8e-6140-4de1-bf95-5cb4469f7d8a tempest-ProjectReaderTests-698185307 None] Acquiring lock "cinder-b0919be1-4d70-49aa-841a-6182962df971-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:07:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6387af8e-6140-4de1-bf95-5cb4469f7d8a tempest-ProjectReaderTests-698185307 None] Lock "cinder-b0919be1-4d70-49aa-841a-6182962df971-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:07:31 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-4549c202-ed9b-42c7-9e24-0cd9856457fb req-382c14f1-df29-4b33-ac96-ea3e7bcd45b6 tempest-TestShelveInstance-1408016595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f" returned: 0 in 0.823s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-4549c202-ed9b-42c7-9e24-0cd9856457fb req-382c14f1-df29-4b33-ac96-ea3e7bcd45b6 tempest-TestShelveInstance-1408016595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6387af8e-6140-4de1-bf95-5cb4469f7d8a tempest-ProjectReaderTests-698185307 None] Acquiring lock "cinder-quobyte-b0919be1-4d70-49aa-841a-6182962df971" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:07:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6387af8e-6140-4de1-bf95-5cb4469f7d8a tempest-ProjectReaderTests-698185307 None] Lock "cinder-quobyte-b0919be1-4d70-49aa-841a-6182962df971" acquired by "delete_volume" :: waited 0.022s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:07:31 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b021db-5469-419c-a8d1-25458817d0e3]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6387af8e-6140-4de1-bf95-5cb4469f7d8a tempest-ProjectReaderTests-698185307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b0919be1-4d70-49aa-841a-6182962df971 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:31 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f Jul 07 22:07:31 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:31 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b0919be1-4d70-49aa-841a-6182962df971 Jul 07 22:07:31 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:32 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-4549c202-ed9b-42c7-9e24-0cd9856457fb req-382c14f1-df29-4b33-ac96-ea3e7bcd45b6 tempest-TestShelveInstance-1408016595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f" returned: 1 in 0.868s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-4549c202-ed9b-42c7-9e24-0cd9856457fb req-382c14f1-df29-4b33-ac96-ea3e7bcd45b6 tempest-TestShelveInstance-1408016595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:07:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-4549c202-ed9b-42c7-9e24-0cd9856457fb req-382c14f1-df29-4b33-ac96-ea3e7bcd45b6 tempest-TestShelveInstance-1408016595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.727s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-4549c202-ed9b-42c7-9e24-0cd9856457fb req-382c14f1-df29-4b33-ac96-ea3e7bcd45b6 tempest-TestShelveInstance-1408016595 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491', 'name': 'volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18089e5a-95b7-4c48-8d1d-7088002d6d50', 'enforce_multipath': True} {{(pid=87586) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4930}} Jul 07 22:07:32 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6387af8e-6140-4de1-bf95-5cb4469f7d8a tempest-ProjectReaderTests-698185307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b0919be1-4d70-49aa-841a-6182962df971" returned: 0 in 0.881s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6387af8e-6140-4de1-bf95-5cb4469f7d8a tempest-ProjectReaderTests-698185307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b0919be1-4d70-49aa-841a-6182962df971 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:32 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-4549c202-ed9b-42c7-9e24-0cd9856457fb req-382c14f1-df29-4b33-ac96-ea3e7bcd45b6 tempest-TestShelveInstance-1408016595 None] attachment_update completed successfully. Jul 07 22:07:32 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b0919be1-4d70-49aa-841a-6182962df971 Jul 07 22:07:32 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:32 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6387af8e-6140-4de1-bf95-5cb4469f7d8a tempest-ProjectReaderTests-698185307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b0919be1-4d70-49aa-841a-6182962df971" returned: 0 in 0.701s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:32 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6387af8e-6140-4de1-bf95-5cb4469f7d8a tempest-ProjectReaderTests-698185307 None] Lock "cinder-quobyte-b0919be1-4d70-49aa-841a-6182962df971" released by "delete_volume" :: held 1.626s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:07:32 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-6387af8e-6140-4de1-bf95-5cb4469f7d8a tempest-ProjectReaderTests-698185307 None] Created reservations ['67e9c574-c3dd-4b65-841a-1baabd07843f', '01955c68-c04e-4b63-9c97-63ce6affb3ce', '1cfab397-4161-463c-8d0b-b9f24282e68a', '25f5ff5d-5604-4210-9be9-36824aa8e2eb'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:07:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6387af8e-6140-4de1-bf95-5cb4469f7d8a tempest-ProjectReaderTests-698185307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:07:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6387af8e-6140-4de1-bf95-5cb4469f7d8a tempest-ProjectReaderTests-698185307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:07:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6387af8e-6140-4de1-bf95-5cb4469f7d8a tempest-ProjectReaderTests-698185307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:07:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6387af8e-6140-4de1-bf95-5cb4469f7d8a tempest-ProjectReaderTests-698185307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:07:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6387af8e-6140-4de1-bf95-5cb4469f7d8a tempest-ProjectReaderTests-698185307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6387af8e-6140-4de1-bf95-5cb4469f7d8a tempest-ProjectReaderTests-698185307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:33 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:07:33 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:33 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6387af8e-6140-4de1-bf95-5cb4469f7d8a tempest-ProjectReaderTests-698185307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.659s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:33 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-6387af8e-6140-4de1-bf95-5cb4469f7d8a tempest-ProjectReaderTests-698185307 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:07:33 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6387af8e-6140-4de1-bf95-5cb4469f7d8a tempest-ProjectReaderTests-698185307 None] Deleted volume successfully. Jul 07 22:07:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6387af8e-6140-4de1-bf95-5cb4469f7d8a tempest-ProjectReaderTests-698185307 None] Lock "cinder-b0919be1-4d70-49aa-841a-6182962df971-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:07:34 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:07:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Flow 'volume_create_manager' (038da8b5-f2c6-4e6c-81b8-3f3aa8ca6c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:07:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2dbbf9-8e79-4e4c-a0bc-e08ae352a422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2dbbf9-8e79-4e4c-a0bc-e08ae352a422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1306528232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcfe5066-29a2-48eb-90d3-84b7a7f359b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb6e36e79af54aafa58fc26e0a4b7884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:07:34Z,use_quota=True,user_id='bea8ec22f8444cbea14c533b1cbe7c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8186cf-22ba-4190-96f9-80fdaba853fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b8186cf-22ba-4190-96f9-80fdaba853fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2019a9f-e654-4504-9dc8-99c8393202b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2019a9f-e654-4504-9dc8-99c8393202b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcfe5066-29a2-48eb-90d3-84b7a7f359b7', 'volume_name': 'volume-dcfe5066-29a2-48eb-90d3-84b7a7f359b7', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30bfb9c0-e5c4-4ec8-bff8-84c53af08db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30bfb9c0-e5c4-4ec8-bff8-84c53af08db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a104e806-6df6-4301-84f1-4fc8ac257259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:34 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Volume dcfe5066-29a2-48eb-90d3-84b7a7f359b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcfe5066-29a2-48eb-90d3-84b7a7f359b7', 'volume_size': 1} Jul 07 22:07:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:07:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:07:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1306528232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcfe5066-29a2-48eb-90d3-84b7a7f359b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb6e36e79af54aafa58fc26e0a4b7884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:07:34Z,use_quota=True,user_id='bea8ec22f8444cbea14c533b1cbe7c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:07:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Creating volume dcfe5066-29a2-48eb-90d3-84b7a7f359b7 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:07:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:07:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:07:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:07:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:07:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:07:34 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:07:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dcfe5066-29a2-48eb-90d3-84b7a7f359b7 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:34 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dcfe5066-29a2-48eb-90d3-84b7a7f359b7 1073741824 Jul 07 22:07:34 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:07:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 28 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 22:07:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 22:07:35 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dcfe5066-29a2-48eb-90d3-84b7a7f359b7 1073741824" returned: 0 in 1.652s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dcfe5066-29a2-48eb-90d3-84b7a7f359b7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:36 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dcfe5066-29a2-48eb-90d3-84b7a7f359b7 Jul 07 22:07:36 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:37 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dcfe5066-29a2-48eb-90d3-84b7a7f359b7" returned: 0 in 1.198s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] <== create_volume: return (2948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:07:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.957s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a104e806-6df6-4301-84f1-4fc8ac257259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcfe5066-29a2-48eb-90d3-84b7a7f359b7', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120be673-bd92-4618-aef8-e00c23056e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:07:37 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Volume volume-dcfe5066-29a2-48eb-90d3-84b7a7f359b7 (dcfe5066-29a2-48eb-90d3-84b7a7f359b7): created successfully Jul 07 22:07:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120be673-bd92-4618-aef8-e00c23056e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:07:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Flow 'volume_create_manager' (038da8b5-f2c6-4e6c-81b8-3f3aa8ca6c7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:07:37 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-e4320044-aa78-47b1-9160-81f79a2821b1 tempest-ProjectReaderTests-698185307 None] Created volume successfully. Jul 07 22:07:38 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b6ed2fb3-6a83-43ac-bc64-ef4dcfc010ce tempest-ProjectReaderTests-698185307 None] Acquiring lock "cinder-dcfe5066-29a2-48eb-90d3-84b7a7f359b7-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:07:38 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b6ed2fb3-6a83-43ac-bc64-ef4dcfc010ce tempest-ProjectReaderTests-698185307 None] Lock "cinder-dcfe5066-29a2-48eb-90d3-84b7a7f359b7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:07:38 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b6ed2fb3-6a83-43ac-bc64-ef4dcfc010ce tempest-ProjectReaderTests-698185307 None] Acquiring lock "cinder-quobyte-dcfe5066-29a2-48eb-90d3-84b7a7f359b7" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:07:38 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b6ed2fb3-6a83-43ac-bc64-ef4dcfc010ce tempest-ProjectReaderTests-698185307 None] Lock "cinder-quobyte-dcfe5066-29a2-48eb-90d3-84b7a7f359b7" acquired by "delete_volume" :: waited 0.037s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:07:39 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99169f3-e513-4017-818f-ef734f660747]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:07:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6ed2fb3-6a83-43ac-bc64-ef4dcfc010ce tempest-ProjectReaderTests-698185307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dcfe5066-29a2-48eb-90d3-84b7a7f359b7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:39 devstack sudo[101607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dcfe5066-29a2-48eb-90d3-84b7a7f359b7 Jul 07 22:07:39 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:40 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6ed2fb3-6a83-43ac-bc64-ef4dcfc010ce tempest-ProjectReaderTests-698185307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dcfe5066-29a2-48eb-90d3-84b7a7f359b7" returned: 0 in 1.985s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6ed2fb3-6a83-43ac-bc64-ef4dcfc010ce tempest-ProjectReaderTests-698185307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dcfe5066-29a2-48eb-90d3-84b7a7f359b7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:41 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dcfe5066-29a2-48eb-90d3-84b7a7f359b7 Jul 07 22:07:41 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:43 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6ed2fb3-6a83-43ac-bc64-ef4dcfc010ce tempest-ProjectReaderTests-698185307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dcfe5066-29a2-48eb-90d3-84b7a7f359b7" returned: 0 in 2.080s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b6ed2fb3-6a83-43ac-bc64-ef4dcfc010ce tempest-ProjectReaderTests-698185307 None] Lock "cinder-quobyte-dcfe5066-29a2-48eb-90d3-84b7a7f359b7" released by "delete_volume" :: held 4.233s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:07:43 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-b6ed2fb3-6a83-43ac-bc64-ef4dcfc010ce tempest-ProjectReaderTests-698185307 None] Created reservations ['2905ddf1-20b5-44c1-90e5-e5d472a2592a', 'f7d188ae-e4a6-4c65-8fbc-a3625d40ad63', '84698e5d-d11f-40a8-ad9b-31c7ecb47eb2', '87196f27-9835-43fb-881f-c7415efdcf7e'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:07:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b6ed2fb3-6a83-43ac-bc64-ef4dcfc010ce tempest-ProjectReaderTests-698185307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:07:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b6ed2fb3-6a83-43ac-bc64-ef4dcfc010ce tempest-ProjectReaderTests-698185307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:07:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed2fb3-6a83-43ac-bc64-ef4dcfc010ce tempest-ProjectReaderTests-698185307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:07:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed2fb3-6a83-43ac-bc64-ef4dcfc010ce tempest-ProjectReaderTests-698185307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:07:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b6ed2fb3-6a83-43ac-bc64-ef4dcfc010ce tempest-ProjectReaderTests-698185307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:07:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6ed2fb3-6a83-43ac-bc64-ef4dcfc010ce tempest-ProjectReaderTests-698185307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:07:43 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:07:43 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:07:45 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Jul 07 22:07:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b6ed2fb3-6a83-43ac-bc64-ef4dcfc010ce tempest-ProjectReaderTests-698185307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.985s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:07:45 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-b6ed2fb3-6a83-43ac-bc64-ef4dcfc010ce tempest-ProjectReaderTests-698185307 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:07:45 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-b6ed2fb3-6a83-43ac-bc64-ef4dcfc010ce tempest-ProjectReaderTests-698185307 None] Deleted volume successfully. Jul 07 22:07:45 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b6ed2fb3-6a83-43ac-bc64-ef4dcfc010ce tempest-ProjectReaderTests-698185307 None] Lock "cinder-dcfe5066-29a2-48eb-90d3-84b7a7f359b7-delete_volume" released by "delete_volume" :: held 6.731s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:07:53 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:UPDATE=90,cinder:SELECT=84,cinder:INSERT=36,cinder:DELETE=6 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:07:55 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:UPDATE=87,cinder:DELETE=10,cinder:SELECT=85,cinder:INSERT=29 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:08:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1d088c30-5358-4f58-adae-deb850dd233e tempest-VolumesNegativeTest-1597862322 None] Acquiring lock "cinder-edba5559-56d0-425a-a366-d814ea7a8bdb-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:08:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1d088c30-5358-4f58-adae-deb850dd233e tempest-VolumesNegativeTest-1597862322 None] Lock "cinder-edba5559-56d0-425a-a366-d814ea7a8bdb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:08:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1d088c30-5358-4f58-adae-deb850dd233e tempest-VolumesNegativeTest-1597862322 None] Acquiring lock "cinder-quobyte-edba5559-56d0-425a-a366-d814ea7a8bdb" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:08:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1d088c30-5358-4f58-adae-deb850dd233e tempest-VolumesNegativeTest-1597862322 None] Lock "cinder-quobyte-edba5559-56d0-425a-a366-d814ea7a8bdb" acquired by "delete_volume" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:08:08 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc6b0c6-e0d3-4153-8c6f-3359dc6f1ad7]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:08:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1d088c30-5358-4f58-adae-deb850dd233e tempest-VolumesNegativeTest-1597862322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-edba5559-56d0-425a-a366-d814ea7a8bdb {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:08:08 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-edba5559-56d0-425a-a366-d814ea7a8bdb Jul 07 22:08:08 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:08:09 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Jul 07 22:08:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1d088c30-5358-4f58-adae-deb850dd233e tempest-VolumesNegativeTest-1597862322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-edba5559-56d0-425a-a366-d814ea7a8bdb" returned: 0 in 0.935s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:08:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1d088c30-5358-4f58-adae-deb850dd233e tempest-VolumesNegativeTest-1597862322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-edba5559-56d0-425a-a366-d814ea7a8bdb {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:08:09 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-edba5559-56d0-425a-a366-d814ea7a8bdb Jul 07 22:08:09 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:08:10 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Jul 07 22:08:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1d088c30-5358-4f58-adae-deb850dd233e tempest-VolumesNegativeTest-1597862322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-edba5559-56d0-425a-a366-d814ea7a8bdb" returned: 0 in 0.739s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:08:10 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1d088c30-5358-4f58-adae-deb850dd233e tempest-VolumesNegativeTest-1597862322 None] Lock "cinder-quobyte-edba5559-56d0-425a-a366-d814ea7a8bdb" released by "delete_volume" :: held 1.735s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:08:10 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-1d088c30-5358-4f58-adae-deb850dd233e tempest-VolumesNegativeTest-1597862322 None] Created reservations ['c93e6c8b-7cce-4d71-89ab-eac93a4b13de', '3fb20f76-97e3-420b-bbe5-afc9a54d150f', '5d35fda4-4835-420e-86ca-ce98634bebb4', '5ec6d224-439e-4ac5-af78-179f84987315'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:08:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1d088c30-5358-4f58-adae-deb850dd233e tempest-VolumesNegativeTest-1597862322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:08:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1d088c30-5358-4f58-adae-deb850dd233e tempest-VolumesNegativeTest-1597862322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:08:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1d088c30-5358-4f58-adae-deb850dd233e tempest-VolumesNegativeTest-1597862322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:08:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1d088c30-5358-4f58-adae-deb850dd233e tempest-VolumesNegativeTest-1597862322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:08:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1d088c30-5358-4f58-adae-deb850dd233e tempest-VolumesNegativeTest-1597862322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:08:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1d088c30-5358-4f58-adae-deb850dd233e tempest-VolumesNegativeTest-1597862322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:08:10 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:08:10 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:08:11 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Jul 07 22:08:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1d088c30-5358-4f58-adae-deb850dd233e tempest-VolumesNegativeTest-1597862322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.770s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:08:11 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-1d088c30-5358-4f58-adae-deb850dd233e tempest-VolumesNegativeTest-1597862322 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:08:11 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-1d088c30-5358-4f58-adae-deb850dd233e tempest-VolumesNegativeTest-1597862322 None] Deleted volume successfully. Jul 07 22:08:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1d088c30-5358-4f58-adae-deb850dd233e tempest-VolumesNegativeTest-1597862322 None] Lock "cinder-edba5559-56d0-425a-a366-d814ea7a8bdb-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:08:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-5e273428-7ecc-4565-b908-0aec1cd0ee8b req-596120f4-443e-4b47-9bed-1aee96fb3ec7 tempest-TestInstancesWithCinderVolumes-1850946614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:08:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-5e273428-7ecc-4565-b908-0aec1cd0ee8b req-596120f4-443e-4b47-9bed-1aee96fb3ec7 tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:08:14 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1dd117-eb65-42ac-ad1a-3b6e9a4429ad]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:08:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-5e273428-7ecc-4565-b908-0aec1cd0ee8b req-596120f4-443e-4b47-9bed-1aee96fb3ec7 tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-636e8d06-b2fe-4b44-8f68-222311cf2303 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:08:14 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-636e8d06-b2fe-4b44-8f68-222311cf2303 Jul 07 22:08:14 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:08:15 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Jul 07 22:08:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-5e273428-7ecc-4565-b908-0aec1cd0ee8b req-596120f4-443e-4b47-9bed-1aee96fb3ec7 tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-636e8d06-b2fe-4b44-8f68-222311cf2303" returned: 0 in 1.114s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:08:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-5e273428-7ecc-4565-b908-0aec1cd0ee8b req-596120f4-443e-4b47-9bed-1aee96fb3ec7 tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.143s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:08:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-5e273428-7ecc-4565-b908-0aec1cd0ee8b req-596120f4-443e-4b47-9bed-1aee96fb3ec7 tempest-TestInstancesWithCinderVolumes-1850946614 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491', 'name': 'volume-636e8d06-b2fe-4b44-8f68-222311cf2303', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5fad35ad-94a7-4ead-a6af-d79fd300f83d', 'enforce_multipath': True} {{(pid=87586) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4930}} Jul 07 22:08:15 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-5e273428-7ecc-4565-b908-0aec1cd0ee8b req-596120f4-443e-4b47-9bed-1aee96fb3ec7 tempest-TestInstancesWithCinderVolumes-1850946614 None] attachment_update completed successfully. Jul 07 22:08:15 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-4a70a75c-37bb-475b-ad97-65b238dcc865 req-ee313547-2087-455c-b808-43ab84c2c6d0 tempest-TestShelveInstance-1408016595 None] Terminate volume connection completed successfully. Jul 07 22:08:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-4a70a75c-37bb-475b-ad97-65b238dcc865 req-ee313547-2087-455c-b808-43ab84c2c6d0 tempest-TestShelveInstance-1408016595 None] Deleting attachment 18089e5a-95b7-4c48-8d1d-7088002d6d50. {{(pid=87586) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 07 22:08:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-2f094477-5f10-4eeb-816e-05c531447c0e req-d688203e-a6b2-40c3-a0bc-cabea3871eae tempest-TestShelveInstance-1408016595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:08:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-2f094477-5f10-4eeb-816e-05c531447c0e req-d688203e-a6b2-40c3-a0bc-cabea3871eae tempest-TestShelveInstance-1408016595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:08:21 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89b7721-ed15-4c93-8b9b-3f2aca2b4187]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:08:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-2f094477-5f10-4eeb-816e-05c531447c0e req-d688203e-a6b2-40c3-a0bc-cabea3871eae tempest-TestShelveInstance-1408016595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:08:21 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f Jul 07 22:08:21 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:08:22 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Jul 07 22:08:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-2f094477-5f10-4eeb-816e-05c531447c0e req-d688203e-a6b2-40c3-a0bc-cabea3871eae tempest-TestShelveInstance-1408016595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f" returned: 0 in 0.904s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:08:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-2f094477-5f10-4eeb-816e-05c531447c0e req-d688203e-a6b2-40c3-a0bc-cabea3871eae tempest-TestShelveInstance-1408016595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:08:22 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f Jul 07 22:08:22 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:08:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-0ae3459b-e86b-4482-8549-393ed984ff18 req-b8032eca-804f-4528-b494-0bf1e127112f tempest-TestInstancesWithCinderVolumes-1850946614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:08:23 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Jul 07 22:08:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-2f094477-5f10-4eeb-816e-05c531447c0e req-d688203e-a6b2-40c3-a0bc-cabea3871eae tempest-TestShelveInstance-1408016595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f" returned: 1 in 0.895s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:08:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-2f094477-5f10-4eeb-816e-05c531447c0e req-d688203e-a6b2-40c3-a0bc-cabea3871eae tempest-TestShelveInstance-1408016595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:08:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-2f094477-5f10-4eeb-816e-05c531447c0e req-d688203e-a6b2-40c3-a0bc-cabea3871eae tempest-TestShelveInstance-1408016595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.861s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:08:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-0ae3459b-e86b-4482-8549-393ed984ff18 req-b8032eca-804f-4528-b494-0bf1e127112f tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.226s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:08:23 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f44a88-1651-4a6d-baa3-0b7c44ae68a5]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:08:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-0ae3459b-e86b-4482-8549-393ed984ff18 req-b8032eca-804f-4528-b494-0bf1e127112f tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f31eac78-3b5d-4baa-9c29-6b32ef794521 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:08:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-2f094477-5f10-4eeb-816e-05c531447c0e req-d688203e-a6b2-40c3-a0bc-cabea3871eae tempest-TestShelveInstance-1408016595 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491', 'name': 'volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d5fe910-b433-44f6-a31c-9dc9c93ea9d0', 'enforce_multipath': True} {{(pid=87586) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4930}} Jul 07 22:08:23 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f31eac78-3b5d-4baa-9c29-6b32ef794521 Jul 07 22:08:23 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:08:23 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-2f094477-5f10-4eeb-816e-05c531447c0e req-d688203e-a6b2-40c3-a0bc-cabea3871eae tempest-TestShelveInstance-1408016595 None] attachment_update completed successfully. Jul 07 22:08:23 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Jul 07 22:08:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-0ae3459b-e86b-4482-8549-393ed984ff18 req-b8032eca-804f-4528-b494-0bf1e127112f tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f31eac78-3b5d-4baa-9c29-6b32ef794521" returned: 0 in 0.862s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:08:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-0ae3459b-e86b-4482-8549-393ed984ff18 req-b8032eca-804f-4528-b494-0bf1e127112f tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.893s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:08:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-0ae3459b-e86b-4482-8549-393ed984ff18 req-b8032eca-804f-4528-b494-0bf1e127112f tempest-TestInstancesWithCinderVolumes-1850946614 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491', 'name': 'volume-f31eac78-3b5d-4baa-9c29-6b32ef794521', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '893ec033-b2d2-4932-8ad6-7dec97b063bf', 'enforce_multipath': True} {{(pid=87586) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4930}} Jul 07 22:08:24 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-0ae3459b-e86b-4482-8549-393ed984ff18 req-b8032eca-804f-4528-b494-0bf1e127112f tempest-TestInstancesWithCinderVolumes-1850946614 None] attachment_update completed successfully. Jul 07 22:08:34 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=24,cinder:INSERT=2,cinder:UPDATE=13 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:08:34 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=21,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:08:34 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-a303989b-c95f-443b-9966-1815933d289d req-18094df4-5a5b-449f-8bbb-9327eeaba713 tempest-TestInstancesWithCinderVolumes-1850946614 None] Terminate volume connection completed successfully. Jul 07 22:08:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-a303989b-c95f-443b-9966-1815933d289d req-18094df4-5a5b-449f-8bbb-9327eeaba713 tempest-TestInstancesWithCinderVolumes-1850946614 None] Deleting attachment 5fad35ad-94a7-4ead-a6af-d79fd300f83d. {{(pid=87586) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 07 22:08:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:08:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:08:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:08:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:08:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:08:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:08:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:08:35 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:08:35 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:08:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0cd9e8e5-1bb6-4c3b-824a-016f8b2ab532 tempest-TestInstancesWithCinderVolumes-1850946614 None] Acquiring lock "cinder-636e8d06-b2fe-4b44-8f68-222311cf2303-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:08:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0cd9e8e5-1bb6-4c3b-824a-016f8b2ab532 tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "cinder-636e8d06-b2fe-4b44-8f68-222311cf2303-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:08:36 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Jul 07 22:08:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.763s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:08:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:08:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:08:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 28 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 22:08:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 22:08:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0cd9e8e5-1bb6-4c3b-824a-016f8b2ab532 tempest-TestInstancesWithCinderVolumes-1850946614 None] Acquiring lock "cinder-quobyte-636e8d06-b2fe-4b44-8f68-222311cf2303" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:08:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0cd9e8e5-1bb6-4c3b-824a-016f8b2ab532 tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "cinder-quobyte-636e8d06-b2fe-4b44-8f68-222311cf2303" acquired by "delete_volume" :: waited 0.022s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:08:36 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde78a30-13a4-4f9c-8e26-8e3dc9d4daf9]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:08:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0cd9e8e5-1bb6-4c3b-824a-016f8b2ab532 tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-636e8d06-b2fe-4b44-8f68-222311cf2303 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:08:36 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-636e8d06-b2fe-4b44-8f68-222311cf2303 Jul 07 22:08:36 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:08:37 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Jul 07 22:08:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0cd9e8e5-1bb6-4c3b-824a-016f8b2ab532 tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-636e8d06-b2fe-4b44-8f68-222311cf2303" returned: 0 in 0.914s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:08:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0cd9e8e5-1bb6-4c3b-824a-016f8b2ab532 tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-636e8d06-b2fe-4b44-8f68-222311cf2303 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:08:37 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-636e8d06-b2fe-4b44-8f68-222311cf2303 Jul 07 22:08:37 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:08:38 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Jul 07 22:08:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0cd9e8e5-1bb6-4c3b-824a-016f8b2ab532 tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-636e8d06-b2fe-4b44-8f68-222311cf2303" returned: 0 in 0.801s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:08:38 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0cd9e8e5-1bb6-4c3b-824a-016f8b2ab532 tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "cinder-quobyte-636e8d06-b2fe-4b44-8f68-222311cf2303" released by "delete_volume" :: held 1.773s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:08:38 devstack cinder-volume[87586]: WARNING cinder.quota [None req-0cd9e8e5-1bb6-4c3b-824a-016f8b2ab532 tempest-TestInstancesWithCinderVolumes-1850946614 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1146892681-1272560874 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1146892681-1272560874, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:08:38 devstack cinder-volume[87586]: WARNING cinder.quota [None req-0cd9e8e5-1bb6-4c3b-824a-016f8b2ab532 tempest-TestInstancesWithCinderVolumes-1850946614 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1146892681-1272560874 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1146892681-1272560874, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:08:38 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-0cd9e8e5-1bb6-4c3b-824a-016f8b2ab532 tempest-TestInstancesWithCinderVolumes-1850946614 None] Created reservations ['5e51c58b-333c-489f-adb0-a2cf5348d651', '633e474a-2202-4c7e-a641-2e4ae760235c', '4a83f965-6980-4d8b-9fb6-60785037dcff', '84a5779b-79eb-4e2f-98dc-16ea101238a1'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:08:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0cd9e8e5-1bb6-4c3b-824a-016f8b2ab532 tempest-TestInstancesWithCinderVolumes-1850946614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:08:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0cd9e8e5-1bb6-4c3b-824a-016f8b2ab532 tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:08:38 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0cd9e8e5-1bb6-4c3b-824a-016f8b2ab532 tempest-TestInstancesWithCinderVolumes-1850946614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:08:38 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0cd9e8e5-1bb6-4c3b-824a-016f8b2ab532 tempest-TestInstancesWithCinderVolumes-1850946614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:08:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0cd9e8e5-1bb6-4c3b-824a-016f8b2ab532 tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:08:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0cd9e8e5-1bb6-4c3b-824a-016f8b2ab532 tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:08:38 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:08:38 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:08:39 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Jul 07 22:08:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0cd9e8e5-1bb6-4c3b-824a-016f8b2ab532 tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.768s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:08:39 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-0cd9e8e5-1bb6-4c3b-824a-016f8b2ab532 tempest-TestInstancesWithCinderVolumes-1850946614 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:08:39 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-0cd9e8e5-1bb6-4c3b-824a-016f8b2ab532 tempest-TestInstancesWithCinderVolumes-1850946614 None] Deleted volume successfully. Jul 07 22:08:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0cd9e8e5-1bb6-4c3b-824a-016f8b2ab532 tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "cinder-636e8d06-b2fe-4b44-8f68-222311cf2303-delete_volume" released by "delete_volume" :: held 2.797s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:08:42 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-496fd905-629f-4194-926d-32d637701507 req-25078461-d474-4385-89dc-4c8036fab25e tempest-TestInstancesWithCinderVolumes-1850946614 None] Terminate volume connection completed successfully. Jul 07 22:08:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-496fd905-629f-4194-926d-32d637701507 req-25078461-d474-4385-89dc-4c8036fab25e tempest-TestInstancesWithCinderVolumes-1850946614 None] Deleting attachment 893ec033-b2d2-4932-8ad6-7dec97b063bf. {{(pid=87586) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 07 22:08:44 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-059e6908-c5fd-4a73-9fcf-e4396f2821f5 tempest-TestInstancesWithCinderVolumes-1850946614 None] Acquiring lock "cinder-f31eac78-3b5d-4baa-9c29-6b32ef794521-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:08:44 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-059e6908-c5fd-4a73-9fcf-e4396f2821f5 tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "cinder-f31eac78-3b5d-4baa-9c29-6b32ef794521-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:08:44 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-059e6908-c5fd-4a73-9fcf-e4396f2821f5 tempest-TestInstancesWithCinderVolumes-1850946614 None] Acquiring lock "cinder-quobyte-f31eac78-3b5d-4baa-9c29-6b32ef794521" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:08:44 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-059e6908-c5fd-4a73-9fcf-e4396f2821f5 tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "cinder-quobyte-f31eac78-3b5d-4baa-9c29-6b32ef794521" acquired by "delete_volume" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:08:44 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[202ce744-04d4-409c-a399-bae2aa258a0f]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:08:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-059e6908-c5fd-4a73-9fcf-e4396f2821f5 tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f31eac78-3b5d-4baa-9c29-6b32ef794521 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:08:44 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f31eac78-3b5d-4baa-9c29-6b32ef794521 Jul 07 22:08:44 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:08:45 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Jul 07 22:08:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-059e6908-c5fd-4a73-9fcf-e4396f2821f5 tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f31eac78-3b5d-4baa-9c29-6b32ef794521" returned: 0 in 1.247s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:08:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-059e6908-c5fd-4a73-9fcf-e4396f2821f5 tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f31eac78-3b5d-4baa-9c29-6b32ef794521 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:08:45 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f31eac78-3b5d-4baa-9c29-6b32ef794521 Jul 07 22:08:45 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:08:46 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Jul 07 22:08:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-059e6908-c5fd-4a73-9fcf-e4396f2821f5 tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f31eac78-3b5d-4baa-9c29-6b32ef794521" returned: 0 in 1.130s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:08:46 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-059e6908-c5fd-4a73-9fcf-e4396f2821f5 tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "cinder-quobyte-f31eac78-3b5d-4baa-9c29-6b32ef794521" released by "delete_volume" :: held 2.491s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:08:46 devstack cinder-volume[87586]: WARNING cinder.quota [None req-059e6908-c5fd-4a73-9fcf-e4396f2821f5 tempest-TestInstancesWithCinderVolumes-1850946614 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1755234590-211612965 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1755234590-211612965, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:08:46 devstack cinder-volume[87586]: WARNING cinder.quota [None req-059e6908-c5fd-4a73-9fcf-e4396f2821f5 tempest-TestInstancesWithCinderVolumes-1850946614 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1755234590-211612965 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1755234590-211612965, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:08:46 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-059e6908-c5fd-4a73-9fcf-e4396f2821f5 tempest-TestInstancesWithCinderVolumes-1850946614 None] Created reservations ['198af8ea-22e6-469d-8ad4-cadd489163c1', 'c8293da4-ea9a-4b26-85b5-2480631e91ea', 'a392b22f-e77c-42e8-96d8-37407d0df52a', '4de4854a-867f-4437-bca2-d43f6510b572'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:08:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-059e6908-c5fd-4a73-9fcf-e4396f2821f5 tempest-TestInstancesWithCinderVolumes-1850946614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:08:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-059e6908-c5fd-4a73-9fcf-e4396f2821f5 tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:08:47 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-059e6908-c5fd-4a73-9fcf-e4396f2821f5 tempest-TestInstancesWithCinderVolumes-1850946614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:08:47 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-059e6908-c5fd-4a73-9fcf-e4396f2821f5 tempest-TestInstancesWithCinderVolumes-1850946614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:08:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-059e6908-c5fd-4a73-9fcf-e4396f2821f5 tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:08:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-059e6908-c5fd-4a73-9fcf-e4396f2821f5 tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:08:47 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:08:47 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:08:48 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Jul 07 22:08:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-059e6908-c5fd-4a73-9fcf-e4396f2821f5 tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.298s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:08:48 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-059e6908-c5fd-4a73-9fcf-e4396f2821f5 tempest-TestInstancesWithCinderVolumes-1850946614 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:08:48 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-059e6908-c5fd-4a73-9fcf-e4396f2821f5 tempest-TestInstancesWithCinderVolumes-1850946614 None] Deleted volume successfully. Jul 07 22:08:48 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-059e6908-c5fd-4a73-9fcf-e4396f2821f5 tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "cinder-f31eac78-3b5d-4baa-9c29-6b32ef794521-delete_volume" released by "delete_volume" :: held 4.303s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:08:53 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-4dd37994-3bd9-4a5a-8b3a-16a2a3a4ff5e req-fd4d89b6-f7ea-4db8-a3b3-f44bf39f1708 tempest-TestInstancesWithCinderVolumes-1850946614 None] Terminate volume connection completed successfully. Jul 07 22:08:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-4dd37994-3bd9-4a5a-8b3a-16a2a3a4ff5e req-fd4d89b6-f7ea-4db8-a3b3-f44bf39f1708 tempest-TestInstancesWithCinderVolumes-1850946614 None] Deleting attachment fcbc74c0-e1ee-4a66-9f18-13c47a891da5. {{(pid=87586) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 07 22:08:57 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] Acquiring lock "cinder-fd9574dd-6238-45c8-8d91-3d4768ccc28a-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:08:57 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "cinder-fd9574dd-6238-45c8-8d91-3d4768ccc28a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:08:57 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] Acquiring lock "cinder-quobyte-fd9574dd-6238-45c8-8d91-3d4768ccc28a" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:08:57 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "cinder-quobyte-fd9574dd-6238-45c8-8d91-3d4768ccc28a" acquired by "delete_volume" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:08:57 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c4a454-c05e-4a8f-ae00-4bffc42464f8]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:08:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:08:57 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a Jul 07 22:08:57 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:08:58 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a" returned: 0 in 0.842s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Flow 'volume_create_manager' (445ea369-2b85-4bd7-bcf8-7051ec8ea0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1b3b1d-bf8b-451d-9934-ddf125652f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1b3b1d-bf8b-451d-9934-ddf125652f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1258835111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd7c20c-6375-4c99-adda-00337c8c5816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1dfcd495a894bb786064ccc9bd36707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:08:58Z,use_quota=True,user_id='6fc6d3dfd7314607a431e99d4f8511b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (157ba9c1-849e-43f4-af7f-f22a1993434a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (157ba9c1-849e-43f4-af7f-f22a1993434a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af2391c2-17a9-42d1-850e-ef913cb5b0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af2391c2-17a9-42d1-850e-ef913cb5b0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bd7c20c-6375-4c99-adda-00337c8c5816', 'volume_name': 'volume-4bd7c20c-6375-4c99-adda-00337c8c5816', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:08:58 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (039e7611-4017-4028-bfc3-b4ea16c98426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (039e7611-4017-4028-bfc3-b4ea16c98426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:08:58 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71382ced-6c0e-41df-b1b4-c5eeb4327be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:08:58 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Volume 4bd7c20c-6375-4c99-adda-00337c8c5816: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bd7c20c-6375-4c99-adda-00337c8c5816', 'volume_size': 1} Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1258835111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd7c20c-6375-4c99-adda-00337c8c5816,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1dfcd495a894bb786064ccc9bd36707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:08:58Z,use_quota=True,user_id='6fc6d3dfd7314607a431e99d4f8511b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Creating volume 4bd7c20c-6375-4c99-adda-00337c8c5816 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:08:58 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:08:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4bd7c20c-6375-4c99-adda-00337c8c5816 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:08:58 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4bd7c20c-6375-4c99-adda-00337c8c5816 1073741824 Jul 07 22:08:58 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:08:59 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Jul 07 22:08:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a" returned: 1 in 0.767s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:08:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:08:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:08:59 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a Jul 07 22:08:59 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:08:59 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Jul 07 22:08:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4bd7c20c-6375-4c99-adda-00337c8c5816 1073741824" returned: 0 in 0.863s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:08:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4bd7c20c-6375-4c99-adda-00337c8c5816 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:08:59 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4bd7c20c-6375-4c99-adda-00337c8c5816 Jul 07 22:08:59 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:08:59 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Jul 07 22:08:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-fd9574dd-6238-45c8-8d91-3d4768ccc28a" returned: 0 in 0.655s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:08:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "cinder-quobyte-fd9574dd-6238-45c8-8d91-3d4768ccc28a" released by "delete_volume" :: held 2.352s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:08:59 devstack cinder-volume[87586]: WARNING cinder.quota [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1191355997-277646526 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1191355997-277646526, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:08:59 devstack cinder-volume[87586]: WARNING cinder.quota [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1191355997-277646526 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1191355997-277646526, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:08:59 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] Created reservations ['db91bbcf-a7f1-4300-b5c6-e9f07fab042f', '089383ec-adb2-4e8d-b6af-d3d0dcac4e55', '4447323b-2422-4ff4-acf8-d33a9cf86541', '72045623-43f0-44f0-a388-fdec17f418f7'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:08:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:08:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:08:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:08:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:08:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:08:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:08:59 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:08:59 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:08:59 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Jul 07 22:08:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4bd7c20c-6375-4c99-adda-00337c8c5816" returned: 0 in 0.686s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:08:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:08:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71382ced-6c0e-41df-b1b4-c5eeb4327be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bd7c20c-6375-4c99-adda-00337c8c5816', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9404fbd-eddd-4b82-8811-f25fd3cea37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:00 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Volume volume-4bd7c20c-6375-4c99-adda-00337c8c5816 (4bd7c20c-6375-4c99-adda-00337c8c5816): created successfully Jul 07 22:09:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9404fbd-eddd-4b82-8811-f25fd3cea37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Flow 'volume_create_manager' (445ea369-2b85-4bd7-bcf8-7051ec8ea0b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:09:00 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-963dccec-af73-4736-a4e7-8d3430a0f9c2 tempest-TestMinimumBasicScenario-491090470 None] Created volume successfully. Jul 07 22:09:00 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.665s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:00 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:09:00 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] Deleted volume successfully. Jul 07 22:09:00 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-e4f9e9b1-7732-4f0b-b360-f9cacdc1142d tempest-TestInstancesWithCinderVolumes-1850946614 None] Lock "cinder-fd9574dd-6238-45c8-8d91-3d4768ccc28a-delete_volume" released by "delete_volume" :: held 3.293s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:09:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-ac90ed61-ba7d-45f8-89cf-41c765fff000 req-4f3d2870-801a-434a-8384-e0a18903c458 tempest-TestMinimumBasicScenario-491090470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-ac90ed61-ba7d-45f8-89cf-41c765fff000 req-4f3d2870-801a-434a-8384-e0a18903c458 tempest-TestMinimumBasicScenario-491090470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:03 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c90ce86-bdab-4e65-8f5e-cb89d821d676]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:09:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-ac90ed61-ba7d-45f8-89cf-41c765fff000 req-4f3d2870-801a-434a-8384-e0a18903c458 tempest-TestMinimumBasicScenario-491090470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4bd7c20c-6375-4c99-adda-00337c8c5816 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:03 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4bd7c20c-6375-4c99-adda-00337c8c5816 Jul 07 22:09:03 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:04 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-ac90ed61-ba7d-45f8-89cf-41c765fff000 req-4f3d2870-801a-434a-8384-e0a18903c458 tempest-TestMinimumBasicScenario-491090470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4bd7c20c-6375-4c99-adda-00337c8c5816" returned: 0 in 0.987s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-ac90ed61-ba7d-45f8-89cf-41c765fff000 req-4f3d2870-801a-434a-8384-e0a18903c458 tempest-TestMinimumBasicScenario-491090470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-ac90ed61-ba7d-45f8-89cf-41c765fff000 req-4f3d2870-801a-434a-8384-e0a18903c458 tempest-TestMinimumBasicScenario-491090470 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491', 'name': 'volume-4bd7c20c-6375-4c99-adda-00337c8c5816', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc51cffb-4890-407e-81bc-bfcf6f373373', 'enforce_multipath': True} {{(pid=87586) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4930}} Jul 07 22:09:04 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-ac90ed61-ba7d-45f8-89cf-41c765fff000 req-4f3d2870-801a-434a-8384-e0a18903c458 tempest-TestMinimumBasicScenario-491090470 None] attachment_update completed successfully. Jul 07 22:09:14 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:09:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Flow 'volume_create_manager' (f154b070-1fb8-4627-b73f-4b80c2ba586e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:09:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42635289-19cc-444b-aa13-36437e379183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42635289-19cc-444b-aa13-36437e379183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1832727224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb6a5b4b69942e38237d8eb91ba8ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:09:14Z,use_quota=True,user_id='40a589ff297f487cbec37556d99f2879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86672bc3-6d79-4380-a027-3adfc0649851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86672bc3-6d79-4380-a027-3adfc0649851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750821ad-fb22-43e5-8fb0-975722270617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750821ad-fb22-43e5-8fb0-975722270617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee', 'volume_name': 'volume-3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326bd613-c024-445b-89cf-ec6c644e59de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326bd613-c024-445b-89cf-ec6c644e59de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c35ff9-285c-45dc-a531-576bdcdb1dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:14 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Volume 3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee', 'volume_size': 1} Jul 07 22:09:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1832727224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb6a5b4b69942e38237d8eb91ba8ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:09:14Z,use_quota=True,user_id='40a589ff297f487cbec37556d99f2879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:09:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Creating volume 3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:09:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:09:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:09:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:09:14 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:09:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:14 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee 1073741824 Jul 07 22:09:14 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:15 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee 1073741824" returned: 0 in 1.036s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:15 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee Jul 07 22:09:15 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:15 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee" returned: 0 in 0.692s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:09:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c35ff9-285c-45dc-a531-576bdcdb1dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0bda428-98f7-4a48-adfb-82305004eda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:15 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Volume volume-3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee (3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee): created successfully Jul 07 22:09:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0bda428-98f7-4a48-adfb-82305004eda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Flow 'volume_create_manager' (f154b070-1fb8-4627-b73f-4b80c2ba586e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:09:15 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-82556be1-fe46-4ece-bcc3-73df170dba53 tempest-ProjectReaderTests-1246434069 None] Created volume successfully. Jul 07 22:09:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0b634d76-87a7-4e0b-a242-7d0627804351 tempest-ProjectReaderTests-1246434069 None] Acquiring lock "cinder-3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:09:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0b634d76-87a7-4e0b-a242-7d0627804351 tempest-ProjectReaderTests-1246434069 None] Lock "cinder-3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:09:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0b634d76-87a7-4e0b-a242-7d0627804351 tempest-ProjectReaderTests-1246434069 None] Acquiring lock "cinder-quobyte-3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:09:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0b634d76-87a7-4e0b-a242-7d0627804351 tempest-ProjectReaderTests-1246434069 None] Lock "cinder-quobyte-3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee" acquired by "delete_volume" :: waited 0.021s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:09:16 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[008decc2-48d0-4b58-b3cf-2cbba57d00ef]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:09:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0b634d76-87a7-4e0b-a242-7d0627804351 tempest-ProjectReaderTests-1246434069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:16 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee Jul 07 22:09:16 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:17 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0b634d76-87a7-4e0b-a242-7d0627804351 tempest-ProjectReaderTests-1246434069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee" returned: 0 in 0.817s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0b634d76-87a7-4e0b-a242-7d0627804351 tempest-ProjectReaderTests-1246434069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:17 devstack sudo[102360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee Jul 07 22:09:17 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:18 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0b634d76-87a7-4e0b-a242-7d0627804351 tempest-ProjectReaderTests-1246434069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee" returned: 0 in 0.893s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0b634d76-87a7-4e0b-a242-7d0627804351 tempest-ProjectReaderTests-1246434069 None] Lock "cinder-quobyte-3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee" released by "delete_volume" :: held 1.759s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:09:18 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-0b634d76-87a7-4e0b-a242-7d0627804351 tempest-ProjectReaderTests-1246434069 None] Created reservations ['871855ca-c5ba-4cde-ab2c-2cd6968f1595', 'c086acf9-953f-4872-9ce9-bf70e29a91fc', 'f206ab6a-0517-4fcf-8ca8-bd31e0099bb2', 'd4b6e09e-d58a-4834-8e31-673f776d42ea'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:09:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0b634d76-87a7-4e0b-a242-7d0627804351 tempest-ProjectReaderTests-1246434069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0b634d76-87a7-4e0b-a242-7d0627804351 tempest-ProjectReaderTests-1246434069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0b634d76-87a7-4e0b-a242-7d0627804351 tempest-ProjectReaderTests-1246434069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:09:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0b634d76-87a7-4e0b-a242-7d0627804351 tempest-ProjectReaderTests-1246434069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:09:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0b634d76-87a7-4e0b-a242-7d0627804351 tempest-ProjectReaderTests-1246434069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0b634d76-87a7-4e0b-a242-7d0627804351 tempest-ProjectReaderTests-1246434069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:18 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:09:18 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:19 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0b634d76-87a7-4e0b-a242-7d0627804351 tempest-ProjectReaderTests-1246434069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.727s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-0b634d76-87a7-4e0b-a242-7d0627804351 tempest-ProjectReaderTests-1246434069 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:09:19 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-0b634d76-87a7-4e0b-a242-7d0627804351 tempest-ProjectReaderTests-1246434069 None] Deleted volume successfully. Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0b634d76-87a7-4e0b-a242-7d0627804351 tempest-ProjectReaderTests-1246434069 None] Lock "cinder-3af35cf2-c3d4-4e0f-9bd8-f8e9f29512ee-delete_volume" released by "delete_volume" :: held 2.720s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Flow 'volume_create_manager' (e132c1bf-48a5-4a6e-9480-93ba5037d9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e4325b-fbf8-4e93-961c-00d6b75749dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e4325b-fbf8-4e93-961c-00d6b75749dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-614820112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f445222c-21cc-4369-8ca8-47b4e7db1ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb6a5b4b69942e38237d8eb91ba8ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:09:19Z,use_quota=True,user_id='40a589ff297f487cbec37556d99f2879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3362c4a0-6b43-4e37-bfe2-4958dc8a7b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3362c4a0-6b43-4e37-bfe2-4958dc8a7b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547521a6-408b-4682-a90f-bc8c908b5ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547521a6-408b-4682-a90f-bc8c908b5ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f445222c-21cc-4369-8ca8-47b4e7db1ad1', 'volume_name': 'volume-f445222c-21cc-4369-8ca8-47b4e7db1ad1', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff0a944-368d-4bf1-87df-36769a618ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cff0a944-368d-4bf1-87df-36769a618ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdca26e9-94b2-419a-a05a-52700f03ca57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:19 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Volume f445222c-21cc-4369-8ca8-47b4e7db1ad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f445222c-21cc-4369-8ca8-47b4e7db1ad1', 'volume_size': 1} Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-614820112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f445222c-21cc-4369-8ca8-47b4e7db1ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb6a5b4b69942e38237d8eb91ba8ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:09:19Z,use_quota=True,user_id='40a589ff297f487cbec37556d99f2879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Creating volume f445222c-21cc-4369-8ca8-47b4e7db1ad1 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:09:19 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:09:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f445222c-21cc-4369-8ca8-47b4e7db1ad1 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:19 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f445222c-21cc-4369-8ca8-47b4e7db1ad1 1073741824 Jul 07 22:09:19 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:20 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f445222c-21cc-4369-8ca8-47b4e7db1ad1 1073741824" returned: 0 in 1.081s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f445222c-21cc-4369-8ca8-47b4e7db1ad1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:20 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f445222c-21cc-4369-8ca8-47b4e7db1ad1 Jul 07 22:09:20 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:21 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f445222c-21cc-4369-8ca8-47b4e7db1ad1" returned: 0 in 0.764s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:09:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdca26e9-94b2-419a-a05a-52700f03ca57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f445222c-21cc-4369-8ca8-47b4e7db1ad1', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7939fc8-ddf3-4cf7-a09d-02f98517ceef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:21 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Volume volume-f445222c-21cc-4369-8ca8-47b4e7db1ad1 (f445222c-21cc-4369-8ca8-47b4e7db1ad1): created successfully Jul 07 22:09:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7939fc8-ddf3-4cf7-a09d-02f98517ceef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Flow 'volume_create_manager' (e132c1bf-48a5-4a6e-9480-93ba5037d9d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:09:21 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-f617c796-6181-43ea-aaab-0d98205a28c0 tempest-ProjectReaderTests-1246434069 None] Created volume successfully. Jul 07 22:09:22 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-cc561abe-5469-40ee-a048-cd4986e75406 req-26fcf4b3-c7a3-4934-839e-9084ac4659c0 tempest-TestShelveInstance-1408016595 None] Terminate volume connection completed successfully. Jul 07 22:09:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-cc561abe-5469-40ee-a048-cd4986e75406 req-26fcf4b3-c7a3-4934-839e-9084ac4659c0 tempest-TestShelveInstance-1408016595 None] Deleting attachment 6d5fe910-b433-44f6-a31c-9dc9c93ea9d0. {{(pid=87586) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 07 22:09:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-06d83c66-bf0e-42ab-90da-823508a7881a tempest-ProjectReaderTests-1246434069 None] Acquiring lock "cinder-f445222c-21cc-4369-8ca8-47b4e7db1ad1-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:09:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-06d83c66-bf0e-42ab-90da-823508a7881a tempest-ProjectReaderTests-1246434069 None] Lock "cinder-f445222c-21cc-4369-8ca8-47b4e7db1ad1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:09:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-06d83c66-bf0e-42ab-90da-823508a7881a tempest-ProjectReaderTests-1246434069 None] Acquiring lock "cinder-quobyte-f445222c-21cc-4369-8ca8-47b4e7db1ad1" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:09:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-06d83c66-bf0e-42ab-90da-823508a7881a tempest-ProjectReaderTests-1246434069 None] Lock "cinder-quobyte-f445222c-21cc-4369-8ca8-47b4e7db1ad1" acquired by "delete_volume" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:09:22 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[022c1515-a7a3-431b-94c3-4ef5c23d473b]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:09:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-06d83c66-bf0e-42ab-90da-823508a7881a tempest-ProjectReaderTests-1246434069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f445222c-21cc-4369-8ca8-47b4e7db1ad1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:22 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f445222c-21cc-4369-8ca8-47b4e7db1ad1 Jul 07 22:09:22 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] Acquiring lock "cinder-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:09:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] Lock "cinder-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:09:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] Acquiring lock "cinder-quobyte-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:09:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] Lock "cinder-quobyte-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f" acquired by "delete_volume" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:09:23 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dad1e5-c5c0-4729-a97d-40b5cdf5b3f9]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:09:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:23 devstack sudo[102414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f Jul 07 22:09:23 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:23 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-06d83c66-bf0e-42ab-90da-823508a7881a tempest-ProjectReaderTests-1246434069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f445222c-21cc-4369-8ca8-47b4e7db1ad1" returned: 0 in 0.923s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-06d83c66-bf0e-42ab-90da-823508a7881a tempest-ProjectReaderTests-1246434069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f445222c-21cc-4369-8ca8-47b4e7db1ad1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:23 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f445222c-21cc-4369-8ca8-47b4e7db1ad1 Jul 07 22:09:23 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:23 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f" returned: 0 in 0.844s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:23 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-06d83c66-bf0e-42ab-90da-823508a7881a tempest-ProjectReaderTests-1246434069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-f445222c-21cc-4369-8ca8-47b4e7db1ad1" returned: 0 in 0.685s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-06d83c66-bf0e-42ab-90da-823508a7881a tempest-ProjectReaderTests-1246434069 None] Lock "cinder-quobyte-f445222c-21cc-4369-8ca8-47b4e7db1ad1" released by "delete_volume" :: held 1.651s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:09:24 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f Jul 07 22:09:24 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:24 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-06d83c66-bf0e-42ab-90da-823508a7881a tempest-ProjectReaderTests-1246434069 None] Created reservations ['d1049657-3853-4310-89a7-91933b5840bb', '9458b49a-7f2c-4603-bf12-54453d3cea7d', '00e7e78c-5cc0-43f4-b9c5-16fee18a9bbb', '2b548cab-6470-4ef3-9ccc-6e73afc51fc4'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:09:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-06d83c66-bf0e-42ab-90da-823508a7881a tempest-ProjectReaderTests-1246434069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-06d83c66-bf0e-42ab-90da-823508a7881a tempest-ProjectReaderTests-1246434069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-06d83c66-bf0e-42ab-90da-823508a7881a tempest-ProjectReaderTests-1246434069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:09:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-06d83c66-bf0e-42ab-90da-823508a7881a tempest-ProjectReaderTests-1246434069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:09:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-06d83c66-bf0e-42ab-90da-823508a7881a tempest-ProjectReaderTests-1246434069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-06d83c66-bf0e-42ab-90da-823508a7881a tempest-ProjectReaderTests-1246434069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:24 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:09:24 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:24 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f" returned: 1 in 1.031s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:09:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:24 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f Jul 07 22:09:24 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:24 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-06d83c66-bf0e-42ab-90da-823508a7881a tempest-ProjectReaderTests-1246434069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.854s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:24 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-06d83c66-bf0e-42ab-90da-823508a7881a tempest-ProjectReaderTests-1246434069 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:09:25 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-06d83c66-bf0e-42ab-90da-823508a7881a tempest-ProjectReaderTests-1246434069 None] Deleted volume successfully. Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-06d83c66-bf0e-42ab-90da-823508a7881a tempest-ProjectReaderTests-1246434069 None] Lock "cinder-f445222c-21cc-4369-8ca8-47b4e7db1ad1-delete_volume" released by "delete_volume" :: held 2.717s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Flow 'volume_create_manager' (1f8c757a-674a-4b3b-ad32-376d5f5e184c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403369c5-cb56-41aa-82a6-856b3821e42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403369c5-cb56-41aa-82a6-856b3821e42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1901045990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb6a5b4b69942e38237d8eb91ba8ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:09:25Z,use_quota=True,user_id='40a589ff297f487cbec37556d99f2879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f22a3713-31b4-4798-ab19-ad2cf6e8e16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f22a3713-31b4-4798-ab19-ad2cf6e8e16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af736dde-dcb5-404f-8809-f6335c57e350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af736dde-dcb5-404f-8809-f6335c57e350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd', 'volume_name': 'volume-5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c2c086-c8b4-4ed9-a5b3-65af5480d735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c2c086-c8b4-4ed9-a5b3-65af5480d735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d037c5a-7327-417a-bf87-46e87df9100f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:25 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Volume 5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd', 'volume_size': 1} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1901045990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb6a5b4b69942e38237d8eb91ba8ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:09:25Z,use_quota=True,user_id='40a589ff297f487cbec37556d99f2879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Creating volume 5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:09:25 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:25 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd 1073741824 Jul 07 22:09:25 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:25 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f" returned: 0 in 0.738s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] Lock "cinder-quobyte-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f" released by "delete_volume" :: held 2.704s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG cinder.quota [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] Created reservations ['8b1b1191-ad3a-4d4a-838e-d05908224205', '088f769a-04e8-41af-b529-6428a433a56b', '16507c89-4af7-4f8d-90dc-5388f961a7d8', '08f649f4-d0f3-4077-b6e8-8a655a731a6a'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:25 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:09:25 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:26 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd 1073741824" returned: 0 in 1.121s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:26 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd Jul 07 22:09:26 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:26 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.842s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:26 devstack cinder-volume[87586]: DEBUG cinder.manager [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:09:26 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] Deleted volume successfully. Jul 07 22:09:26 devstack cinder-volume[87586]: DEBUG cinder.coordination [req-cc561abe-5469-40ee-a048-cd4986e75406 req-90fca061-55cd-4e49-a935-ebd0ad5c0611 tempest-TestShelveInstance-1408016595 None] Lock "cinder-6b654f0c-dd12-4cb5-85d7-fedcb5b71b4f-delete_volume" released by "delete_volume" :: held 3.860s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:09:27 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd" returned: 0 in 0.875s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:27 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:09:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:27 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d037c5a-7327-417a-bf87-46e87df9100f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:27 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076db285-a837-423a-9e1b-638e34b2cb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:27 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Volume volume-5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd (5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd): created successfully Jul 07 22:09:27 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076db285-a837-423a-9e1b-638e34b2cb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:27 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Flow 'volume_create_manager' (1f8c757a-674a-4b3b-ad32-376d5f5e184c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:09:27 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6e83614a-88a4-40c9-b7e1-b78f1791dda3 tempest-ProjectReaderTests-1246434069 None] Created volume successfully. Jul 07 22:09:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4c63bbf5-a07a-4213-aa2a-22985c2e0e91 tempest-ProjectReaderTests-1246434069 None] Acquiring lock "cinder-5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:09:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4c63bbf5-a07a-4213-aa2a-22985c2e0e91 tempest-ProjectReaderTests-1246434069 None] Lock "cinder-5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:09:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4c63bbf5-a07a-4213-aa2a-22985c2e0e91 tempest-ProjectReaderTests-1246434069 None] Acquiring lock "cinder-quobyte-5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:09:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4c63bbf5-a07a-4213-aa2a-22985c2e0e91 tempest-ProjectReaderTests-1246434069 None] Lock "cinder-quobyte-5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd" acquired by "delete_volume" :: waited 0.029s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:09:28 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[314a5167-79b5-434d-b535-0389aa8ad619]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:09:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4c63bbf5-a07a-4213-aa2a-22985c2e0e91 tempest-ProjectReaderTests-1246434069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:28 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd Jul 07 22:09:28 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:29 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4c63bbf5-a07a-4213-aa2a-22985c2e0e91 tempest-ProjectReaderTests-1246434069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd" returned: 0 in 0.905s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4c63bbf5-a07a-4213-aa2a-22985c2e0e91 tempest-ProjectReaderTests-1246434069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:29 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd Jul 07 22:09:29 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:30 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4c63bbf5-a07a-4213-aa2a-22985c2e0e91 tempest-ProjectReaderTests-1246434069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd" returned: 0 in 0.766s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:30 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4c63bbf5-a07a-4213-aa2a-22985c2e0e91 tempest-ProjectReaderTests-1246434069 None] Lock "cinder-quobyte-5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd" released by "delete_volume" :: held 1.764s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:09:30 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-4c63bbf5-a07a-4213-aa2a-22985c2e0e91 tempest-ProjectReaderTests-1246434069 None] Created reservations ['4fcc5889-ccc1-471e-a5cd-c0108231faeb', '372be31a-8005-4e04-9bb3-2e2dbf14b7bc', 'dc1d552f-5cb3-4c9a-8ab6-135b33e1920b', '887d2e84-4280-4ce7-b2ee-a06736c4c953'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:09:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4c63bbf5-a07a-4213-aa2a-22985c2e0e91 tempest-ProjectReaderTests-1246434069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4c63bbf5-a07a-4213-aa2a-22985c2e0e91 tempest-ProjectReaderTests-1246434069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4c63bbf5-a07a-4213-aa2a-22985c2e0e91 tempest-ProjectReaderTests-1246434069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:09:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4c63bbf5-a07a-4213-aa2a-22985c2e0e91 tempest-ProjectReaderTests-1246434069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:09:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4c63bbf5-a07a-4213-aa2a-22985c2e0e91 tempest-ProjectReaderTests-1246434069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4c63bbf5-a07a-4213-aa2a-22985c2e0e91 tempest-ProjectReaderTests-1246434069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:30 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:09:30 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:31 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4c63bbf5-a07a-4213-aa2a-22985c2e0e91 tempest-ProjectReaderTests-1246434069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.904s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-4c63bbf5-a07a-4213-aa2a-22985c2e0e91 tempest-ProjectReaderTests-1246434069 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:09:31 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-4c63bbf5-a07a-4213-aa2a-22985c2e0e91 tempest-ProjectReaderTests-1246434069 None] Deleted volume successfully. Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Flow 'volume_create_manager' (220b02aa-714b-48b4-bca9-4b354b69b7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd8e7ab-9111-45e4-a62a-09f54a680048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd8e7ab-9111-45e4-a62a-09f54a680048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1975921709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df350706-e1ee-4d34-8e3a-9411f0856e67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb6a5b4b69942e38237d8eb91ba8ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:09:31Z,use_quota=True,user_id='40a589ff297f487cbec37556d99f2879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0c1b55-c5af-405f-8b1c-bd2474bffaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0c1b55-c5af-405f-8b1c-bd2474bffaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9bd546e-8a06-4a96-bb5a-90ebc78eb1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9bd546e-8a06-4a96-bb5a-90ebc78eb1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df350706-e1ee-4d34-8e3a-9411f0856e67', 'volume_name': 'volume-df350706-e1ee-4d34-8e3a-9411f0856e67', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0812ecb-7e68-4727-811f-ce51c202cf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0812ecb-7e68-4727-811f-ce51c202cf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9f6827-bcda-46f8-9199-3adbe9da4ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:31 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Volume df350706-e1ee-4d34-8e3a-9411f0856e67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df350706-e1ee-4d34-8e3a-9411f0856e67', 'volume_size': 1} Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1975921709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df350706-e1ee-4d34-8e3a-9411f0856e67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb6a5b4b69942e38237d8eb91ba8ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:09:31Z,use_quota=True,user_id='40a589ff297f487cbec37556d99f2879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Creating volume df350706-e1ee-4d34-8e3a-9411f0856e67 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:09:31 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df350706-e1ee-4d34-8e3a-9411f0856e67 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4c63bbf5-a07a-4213-aa2a-22985c2e0e91 tempest-ProjectReaderTests-1246434069 None] Lock "cinder-5c3b1e33-a2e0-479b-9a18-b5b0a88f28fd-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:09:31 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df350706-e1ee-4d34-8e3a-9411f0856e67 1073741824 Jul 07 22:09:31 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:32 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df350706-e1ee-4d34-8e3a-9411f0856e67 1073741824" returned: 0 in 0.935s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df350706-e1ee-4d34-8e3a-9411f0856e67 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:32 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df350706-e1ee-4d34-8e3a-9411f0856e67 Jul 07 22:09:32 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:33 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df350706-e1ee-4d34-8e3a-9411f0856e67" returned: 0 in 0.761s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:33 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:09:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9f6827-bcda-46f8-9199-3adbe9da4ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df350706-e1ee-4d34-8e3a-9411f0856e67', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8391d6a4-0a50-4895-bc47-dd1e14d9ebaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:33 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Volume volume-df350706-e1ee-4d34-8e3a-9411f0856e67 (df350706-e1ee-4d34-8e3a-9411f0856e67): created successfully Jul 07 22:09:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8391d6a4-0a50-4895-bc47-dd1e14d9ebaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:33 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Flow 'volume_create_manager' (220b02aa-714b-48b4-bca9-4b354b69b7a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:09:33 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-f66f5787-7a99-44d6-94fc-281151649e2c tempest-ProjectReaderTests-1246434069 None] Created volume successfully. Jul 07 22:09:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-2e627dde-c2b5-48f7-9d5c-c6222e596f08 tempest-ProjectReaderTests-1246434069 None] Acquiring lock "cinder-df350706-e1ee-4d34-8e3a-9411f0856e67-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:09:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-2e627dde-c2b5-48f7-9d5c-c6222e596f08 tempest-ProjectReaderTests-1246434069 None] Lock "cinder-df350706-e1ee-4d34-8e3a-9411f0856e67-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:09:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-2e627dde-c2b5-48f7-9d5c-c6222e596f08 tempest-ProjectReaderTests-1246434069 None] Acquiring lock "cinder-quobyte-df350706-e1ee-4d34-8e3a-9411f0856e67" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:09:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-2e627dde-c2b5-48f7-9d5c-c6222e596f08 tempest-ProjectReaderTests-1246434069 None] Lock "cinder-quobyte-df350706-e1ee-4d34-8e3a-9411f0856e67" acquired by "delete_volume" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:09:33 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9df635-ae6e-4279-9232-09ae8741de01]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:09:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2e627dde-c2b5-48f7-9d5c-c6222e596f08 tempest-ProjectReaderTests-1246434069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df350706-e1ee-4d34-8e3a-9411f0856e67 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:33 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df350706-e1ee-4d34-8e3a-9411f0856e67 Jul 07 22:09:33 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:34 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2e627dde-c2b5-48f7-9d5c-c6222e596f08 tempest-ProjectReaderTests-1246434069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df350706-e1ee-4d34-8e3a-9411f0856e67" returned: 0 in 0.878s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2e627dde-c2b5-48f7-9d5c-c6222e596f08 tempest-ProjectReaderTests-1246434069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df350706-e1ee-4d34-8e3a-9411f0856e67 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:34 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df350706-e1ee-4d34-8e3a-9411f0856e67 Jul 07 22:09:34 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:35 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2e627dde-c2b5-48f7-9d5c-c6222e596f08 tempest-ProjectReaderTests-1246434069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-df350706-e1ee-4d34-8e3a-9411f0856e67" returned: 0 in 0.857s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-2e627dde-c2b5-48f7-9d5c-c6222e596f08 tempest-ProjectReaderTests-1246434069 None] Lock "cinder-quobyte-df350706-e1ee-4d34-8e3a-9411f0856e67" released by "delete_volume" :: held 1.801s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:09:35 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=65,cinder:INSERT=21,cinder:UPDATE=75,cinder:DELETE=5 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:09:35 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:UPDATE=72,cinder:SELECT=49,cinder:INSERT=12,cinder:DELETE=7 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:09:35 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-2e627dde-c2b5-48f7-9d5c-c6222e596f08 tempest-ProjectReaderTests-1246434069 None] Created reservations ['80178a29-02a6-4a20-953e-85326d3e332c', 'accfbe20-0fc4-4963-9610-5f2e5ba5f419', '06234caa-4357-46e8-a16a-c74dc8ec2013', 'b416341a-8be3-4cba-94bf-150f73bfe580'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:09:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:09:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:09:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:09:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:35 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:09:35 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2e627dde-c2b5-48f7-9d5c-c6222e596f08 tempest-ProjectReaderTests-1246434069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2e627dde-c2b5-48f7-9d5c-c6222e596f08 tempest-ProjectReaderTests-1246434069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2e627dde-c2b5-48f7-9d5c-c6222e596f08 tempest-ProjectReaderTests-1246434069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:09:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2e627dde-c2b5-48f7-9d5c-c6222e596f08 tempest-ProjectReaderTests-1246434069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:09:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2e627dde-c2b5-48f7-9d5c-c6222e596f08 tempest-ProjectReaderTests-1246434069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2e627dde-c2b5-48f7-9d5c-c6222e596f08 tempest-ProjectReaderTests-1246434069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:35 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:09:35 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:36 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.195s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:09:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:09:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 28 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 22:09:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 22:09:36 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2e627dde-c2b5-48f7-9d5c-c6222e596f08 tempest-ProjectReaderTests-1246434069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.117s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-2e627dde-c2b5-48f7-9d5c-c6222e596f08 tempest-ProjectReaderTests-1246434069 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:09:36 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-2e627dde-c2b5-48f7-9d5c-c6222e596f08 tempest-ProjectReaderTests-1246434069 None] Deleted volume successfully. Jul 07 22:09:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-2e627dde-c2b5-48f7-9d5c-c6222e596f08 tempest-ProjectReaderTests-1246434069 None] Lock "cinder-df350706-e1ee-4d34-8e3a-9411f0856e67-delete_volume" released by "delete_volume" :: held 3.352s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:09:39 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:09:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Flow 'volume_create_manager' (8562dce9-4596-44ec-b1d1-cd2eef7126cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae545160-d69b-4413-b1d7-f9a148b86857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae545160-d69b-4413-b1d7-f9a148b86857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-528056818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7beb6126-1aa7-44a9-a54c-5c1f1c587abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9aa813f26b64da78b2c365989304547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:09:40Z,use_quota=True,user_id='51df1c5ee9b9489f9b32022219565174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1297f8b0-6481-4a79-8cb9-4149837ac0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1297f8b0-6481-4a79-8cb9-4149837ac0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad65fcd-d190-4777-9d31-e9f8d58122da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad65fcd-d190-4777-9d31-e9f8d58122da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7beb6126-1aa7-44a9-a54c-5c1f1c587abe', 'volume_name': 'volume-7beb6126-1aa7-44a9-a54c-5c1f1c587abe', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e1f44c-d21c-48ab-9719-0f5475fc709b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e1f44c-d21c-48ab-9719-0f5475fc709b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140d8e28-de3d-4d0e-9381-84a03cde2d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:40 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Volume 7beb6126-1aa7-44a9-a54c-5c1f1c587abe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7beb6126-1aa7-44a9-a54c-5c1f1c587abe', 'volume_size': 1} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-528056818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7beb6126-1aa7-44a9-a54c-5c1f1c587abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9aa813f26b64da78b2c365989304547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:09:40Z,use_quota=True,user_id='51df1c5ee9b9489f9b32022219565174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Creating volume 7beb6126-1aa7-44a9-a54c-5c1f1c587abe {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:09:40 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7beb6126-1aa7-44a9-a54c-5c1f1c587abe 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:40 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7beb6126-1aa7-44a9-a54c-5c1f1c587abe 1073741824 Jul 07 22:09:40 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Flow 'volume_create_manager' (359095ca-691b-40b2-8018-4cac3dbc81e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbbcb16-63e2-4794-a4f6-347be15441f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbbcb16-63e2-4794-a4f6-347be15441f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1545964485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a80933d-bf20-4df4-9a28-e586f25f464b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9aa813f26b64da78b2c365989304547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:09:40Z,use_quota=True,user_id='51df1c5ee9b9489f9b32022219565174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9cc1133-c708-4154-ae52-942f61486465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9cc1133-c708-4154-ae52-942f61486465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12594cb-0cbd-4fdf-9615-6be098a920ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12594cb-0cbd-4fdf-9615-6be098a920ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a80933d-bf20-4df4-9a28-e586f25f464b', 'volume_name': 'volume-1a80933d-bf20-4df4-9a28-e586f25f464b', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1aa368e-b8db-4954-b85f-09db87579bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1aa368e-b8db-4954-b85f-09db87579bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb0fa09-134b-49a5-86c6-b782ff9258ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:40 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Volume 1a80933d-bf20-4df4-9a28-e586f25f464b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a80933d-bf20-4df4-9a28-e586f25f464b', 'volume_size': 1} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Flow 'volume_create_manager' (1456564a-3a97-4554-aba6-c0acce3c4f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (393ba445-9faa-41fa-9e40-b06be998ede2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (393ba445-9faa-41fa-9e40-b06be998ede2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1395707825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8a6e81-2577-4731-8a7e-d6820bd91ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9aa813f26b64da78b2c365989304547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:09:41Z,use_quota=True,user_id='51df1c5ee9b9489f9b32022219565174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03fb0932-1809-4d31-a16b-87d00f158be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03fb0932-1809-4d31-a16b-87d00f158be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b1b67d-f42d-48e2-8f4e-b1f9c25afe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b1b67d-f42d-48e2-8f4e-b1f9c25afe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c8a6e81-2577-4731-8a7e-d6820bd91ad7', 'volume_name': 'volume-0c8a6e81-2577-4731-8a7e-d6820bd91ad7', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ac343f-6652-4cf4-b352-ac39545700c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ac343f-6652-4cf4-b352-ac39545700c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f615689f-7975-4174-a2cb-52f1994197cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:40 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Volume 0c8a6e81-2577-4731-8a7e-d6820bd91ad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c8a6e81-2577-4731-8a7e-d6820bd91ad7', 'volume_size': 1} Jul 07 22:09:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:41 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Flow 'volume_create_manager' (53ce3a80-da59-4f32-a0b0-be86ce91f021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376d9f22-014e-405d-851f-fbe445860604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7beb6126-1aa7-44a9-a54c-5c1f1c587abe 1073741824" returned: 0 in 1.096s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376d9f22-014e-405d-851f-fbe445860604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1905231911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9aa813f26b64da78b2c365989304547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:09:41Z,use_quota=True,user_id='51df1c5ee9b9489f9b32022219565174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ba2482-0029-470a-a99d-14f735a1f4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ba2482-0029-470a-a99d-14f735a1f4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c6f160-87d3-476c-8585-9ed63c4037cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c6f160-87d3-476c-8585-9ed63c4037cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba', 'volume_name': 'volume-c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4ac899-f65b-419c-b92e-bdee25a5277b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4ac899-f65b-419c-b92e-bdee25a5277b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc63ba5-bdbd-4678-9ada-f8f848cea92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:41 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Volume c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba', 'volume_size': 1} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7beb6126-1aa7-44a9-a54c-5c1f1c587abe {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:41 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7beb6126-1aa7-44a9-a54c-5c1f1c587abe Jul 07 22:09:41 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Flow 'volume_create_manager' (cf33c3bc-9a0e-48da-b18d-f6859cf1f696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b491e6db-37d2-4d05-ae98-e857c20a4ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b491e6db-37d2-4d05-ae98-e857c20a4ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-621472349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf9f465-038b-4a74-a270-5db1580d1357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9aa813f26b64da78b2c365989304547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:09:42Z,use_quota=True,user_id='51df1c5ee9b9489f9b32022219565174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c48f724-3d1d-4e04-9624-87c112562080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c48f724-3d1d-4e04-9624-87c112562080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee2d646-830b-4a89-8e08-8e8ab5ab6469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee2d646-830b-4a89-8e08-8e8ab5ab6469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acf9f465-038b-4a74-a270-5db1580d1357', 'volume_name': 'volume-acf9f465-038b-4a74-a270-5db1580d1357', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8fd825-0a74-49b7-a1c5-7be8f756d023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8fd825-0a74-49b7-a1c5-7be8f756d023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a167cc84-0fe1-41cb-99fb-22219e7bfd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:41 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Volume acf9f465-038b-4a74-a270-5db1580d1357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acf9f465-038b-4a74-a270-5db1580d1357', 'volume_size': 1} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:41 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7beb6126-1aa7-44a9-a54c-5c1f1c587abe" returned: 0 in 0.632s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.444s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1545964485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a80933d-bf20-4df4-9a28-e586f25f464b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9aa813f26b64da78b2c365989304547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:09:40Z,use_quota=True,user_id='51df1c5ee9b9489f9b32022219565174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Creating volume 1a80933d-bf20-4df4-9a28-e586f25f464b {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:09:41 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1a80933d-bf20-4df4-9a28-e586f25f464b 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:41 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1a80933d-bf20-4df4-9a28-e586f25f464b 1073741824 Jul 07 22:09:41 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (140d8e28-de3d-4d0e-9381-84a03cde2d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7beb6126-1aa7-44a9-a54c-5c1f1c587abe', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e108b231-9cca-4441-b9bc-85c2190527d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:41 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Volume volume-7beb6126-1aa7-44a9-a54c-5c1f1c587abe (7beb6126-1aa7-44a9-a54c-5c1f1c587abe): created successfully Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e108b231-9cca-4441-b9bc-85c2190527d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:41 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Flow 'volume_create_manager' (8562dce9-4596-44ec-b1d1-cd2eef7126cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:09:41 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-49e9e4d4-185a-4e0c-b83d-7445fd035e5b tempest-CreateVolumesFromImageTest-1222378736 None] Created volume successfully. Jul 07 22:09:42 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1a80933d-bf20-4df4-9a28-e586f25f464b 1073741824" returned: 0 in 0.817s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1a80933d-bf20-4df4-9a28-e586f25f464b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:42 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1a80933d-bf20-4df4-9a28-e586f25f464b Jul 07 22:09:42 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:43 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1a80933d-bf20-4df4-9a28-e586f25f464b" returned: 0 in 0.674s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:09:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.542s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1395707825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8a6e81-2577-4731-8a7e-d6820bd91ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9aa813f26b64da78b2c365989304547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:09:41Z,use_quota=True,user_id='51df1c5ee9b9489f9b32022219565174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:09:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Creating volume 0c8a6e81-2577-4731-8a7e-d6820bd91ad7 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:09:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:09:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:09:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:09:43 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:09:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0c8a6e81-2577-4731-8a7e-d6820bd91ad7 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb0fa09-134b-49a5-86c6-b782ff9258ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a80933d-bf20-4df4-9a28-e586f25f464b', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:43 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0c8a6e81-2577-4731-8a7e-d6820bd91ad7 1073741824 Jul 07 22:09:43 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f08c3c6-2a24-4ca2-86a5-27b52e116171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:43 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Volume volume-1a80933d-bf20-4df4-9a28-e586f25f464b (1a80933d-bf20-4df4-9a28-e586f25f464b): created successfully Jul 07 22:09:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f08c3c6-2a24-4ca2-86a5-27b52e116171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:43 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Flow 'volume_create_manager' (359095ca-691b-40b2-8018-4cac3dbc81e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:09:43 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-2b5dd358-d3a3-45a6-b29b-5e35ae65cd12 tempest-CreateVolumesFromImageTest-1222378736 None] Created volume successfully. Jul 07 22:09:44 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0c8a6e81-2577-4731-8a7e-d6820bd91ad7 1073741824" returned: 0 in 0.790s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0c8a6e81-2577-4731-8a7e-d6820bd91ad7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:44 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0c8a6e81-2577-4731-8a7e-d6820bd91ad7 Jul 07 22:09:44 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:44 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0c8a6e81-2577-4731-8a7e-d6820bd91ad7" returned: 0 in 0.613s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:44 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:09:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.634s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:44 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1905231911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9aa813f26b64da78b2c365989304547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:09:41Z,use_quota=True,user_id='51df1c5ee9b9489f9b32022219565174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:09:44 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Creating volume c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:09:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:44 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:09:44 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:09:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:44 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:09:44 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:09:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:44 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba 1073741824 Jul 07 22:09:44 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:44 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f615689f-7975-4174-a2cb-52f1994197cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c8a6e81-2577-4731-8a7e-d6820bd91ad7', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:44 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aabec6d-0b7b-4157-b141-a50b5bd17663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:44 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Volume volume-0c8a6e81-2577-4731-8a7e-d6820bd91ad7 (0c8a6e81-2577-4731-8a7e-d6820bd91ad7): created successfully Jul 07 22:09:44 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aabec6d-0b7b-4157-b141-a50b5bd17663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:44 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Flow 'volume_create_manager' (1456564a-3a97-4554-aba6-c0acce3c4f1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:09:44 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-e12f7696-1ef5-47f4-9f25-61205d2c427f tempest-CreateVolumesFromImageTest-1222378736 None] Created volume successfully. Jul 07 22:09:45 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba 1073741824" returned: 0 in 0.821s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:45 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba Jul 07 22:09:45 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:46 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba" returned: 0 in 0.631s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:46 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:09:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.695s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:46 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-621472349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf9f465-038b-4a74-a270-5db1580d1357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9aa813f26b64da78b2c365989304547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:09:42Z,use_quota=True,user_id='51df1c5ee9b9489f9b32022219565174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:09:46 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Creating volume acf9f465-038b-4a74-a270-5db1580d1357 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:09:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:46 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:09:46 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:09:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:46 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:09:46 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:09:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-acf9f465-038b-4a74-a270-5db1580d1357 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc63ba5-bdbd-4678-9ada-f8f848cea92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:46 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-acf9f465-038b-4a74-a270-5db1580d1357 1073741824 Jul 07 22:09:46 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76e0d94-b684-4f4c-bc95-53f5fa571b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:46 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Volume volume-c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba (c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba): created successfully Jul 07 22:09:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76e0d94-b684-4f4c-bc95-53f5fa571b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Flow 'volume_create_manager' (53ce3a80-da59-4f32-a0b0-be86ce91f021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:09:46 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-fe237e96-1b8c-456d-903f-a8ac606708b8 tempest-CreateVolumesFromImageTest-1222378736 None] Created volume successfully. Jul 07 22:09:47 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-acf9f465-038b-4a74-a270-5db1580d1357 1073741824" returned: 0 in 0.875s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-acf9f465-038b-4a74-a270-5db1580d1357 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:47 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-acf9f465-038b-4a74-a270-5db1580d1357 Jul 07 22:09:47 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:47 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-acf9f465-038b-4a74-a270-5db1580d1357" returned: 0 in 0.692s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:47 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:09:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a167cc84-0fe1-41cb-99fb-22219e7bfd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acf9f465-038b-4a74-a270-5db1580d1357', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f27f5f31-8f2b-4ecc-b49c-55e84df68604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:09:48 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Volume volume-acf9f465-038b-4a74-a270-5db1580d1357 (acf9f465-038b-4a74-a270-5db1580d1357): created successfully Jul 07 22:09:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f27f5f31-8f2b-4ecc-b49c-55e84df68604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:09:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Flow 'volume_create_manager' (cf33c3bc-9a0e-48da-b18d-f6859cf1f696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:09:48 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-48e87c4b-f190-412f-ae43-125d639d24b5 tempest-CreateVolumesFromImageTest-1222378736 None] Created volume successfully. Jul 07 22:09:49 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-382606cf-33a2-4294-9866-9f8679356a0e tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "cinder-acf9f465-038b-4a74-a270-5db1580d1357-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:09:49 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-382606cf-33a2-4294-9866-9f8679356a0e tempest-CreateVolumesFromImageTest-1222378736 None] Lock "cinder-acf9f465-038b-4a74-a270-5db1580d1357-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:09:49 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-382606cf-33a2-4294-9866-9f8679356a0e tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "cinder-quobyte-acf9f465-038b-4a74-a270-5db1580d1357" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:09:49 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-382606cf-33a2-4294-9866-9f8679356a0e tempest-CreateVolumesFromImageTest-1222378736 None] Lock "cinder-quobyte-acf9f465-038b-4a74-a270-5db1580d1357" acquired by "delete_volume" :: waited 0.014s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:09:49 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e4a01a-e0a5-46d9-a5bb-05adce118760]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:09:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-382606cf-33a2-4294-9866-9f8679356a0e tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-acf9f465-038b-4a74-a270-5db1580d1357 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:49 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-acf9f465-038b-4a74-a270-5db1580d1357 Jul 07 22:09:49 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:50 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-382606cf-33a2-4294-9866-9f8679356a0e tempest-CreateVolumesFromImageTest-1222378736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-acf9f465-038b-4a74-a270-5db1580d1357" returned: 0 in 0.762s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-382606cf-33a2-4294-9866-9f8679356a0e tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-acf9f465-038b-4a74-a270-5db1580d1357 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:50 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-acf9f465-038b-4a74-a270-5db1580d1357 Jul 07 22:09:50 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:50 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-382606cf-33a2-4294-9866-9f8679356a0e tempest-CreateVolumesFromImageTest-1222378736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-acf9f465-038b-4a74-a270-5db1580d1357" returned: 0 in 0.639s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:50 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-382606cf-33a2-4294-9866-9f8679356a0e tempest-CreateVolumesFromImageTest-1222378736 None] Lock "cinder-quobyte-acf9f465-038b-4a74-a270-5db1580d1357" released by "delete_volume" :: held 1.439s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:09:50 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-382606cf-33a2-4294-9866-9f8679356a0e tempest-CreateVolumesFromImageTest-1222378736 None] Created reservations ['51308fc3-8c69-4fd6-b276-6591e51033b6', 'ad22f901-777e-48b5-bb16-71356b9f0e6d', 'ffb82690-b3c6-4817-9671-3f89ef377af4', 'd4ecd53b-4be2-4093-b216-e40e7e636378'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:09:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-382606cf-33a2-4294-9866-9f8679356a0e tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-382606cf-33a2-4294-9866-9f8679356a0e tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-382606cf-33a2-4294-9866-9f8679356a0e tempest-CreateVolumesFromImageTest-1222378736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:09:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-382606cf-33a2-4294-9866-9f8679356a0e tempest-CreateVolumesFromImageTest-1222378736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:09:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-382606cf-33a2-4294-9866-9f8679356a0e tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-382606cf-33a2-4294-9866-9f8679356a0e tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:50 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:09:50 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-06b479f6-e419-4a99-a188-d8cc314feda8 tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "cinder-c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:09:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-06b479f6-e419-4a99-a188-d8cc314feda8 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "cinder-c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:09:51 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-06b479f6-e419-4a99-a188-d8cc314feda8 tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "cinder-quobyte-c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:09:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-382606cf-33a2-4294-9866-9f8679356a0e tempest-CreateVolumesFromImageTest-1222378736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.654s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:51 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-382606cf-33a2-4294-9866-9f8679356a0e tempest-CreateVolumesFromImageTest-1222378736 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:09:51 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-382606cf-33a2-4294-9866-9f8679356a0e tempest-CreateVolumesFromImageTest-1222378736 None] Deleted volume successfully. Jul 07 22:09:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-06b479f6-e419-4a99-a188-d8cc314feda8 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "cinder-quobyte-c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba" acquired by "delete_volume" :: waited 0.025s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:09:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-382606cf-33a2-4294-9866-9f8679356a0e tempest-CreateVolumesFromImageTest-1222378736 None] Lock "cinder-acf9f465-038b-4a74-a270-5db1580d1357-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:09:51 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc739e44-c131-44cf-890e-b8d6b10be9f1]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:09:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-06b479f6-e419-4a99-a188-d8cc314feda8 tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:51 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba Jul 07 22:09:51 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:52 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-06b479f6-e419-4a99-a188-d8cc314feda8 tempest-CreateVolumesFromImageTest-1222378736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba" returned: 0 in 0.768s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-06b479f6-e419-4a99-a188-d8cc314feda8 tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:52 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba Jul 07 22:09:52 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:53 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-06b479f6-e419-4a99-a188-d8cc314feda8 tempest-CreateVolumesFromImageTest-1222378736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba" returned: 0 in 0.706s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:53 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-06b479f6-e419-4a99-a188-d8cc314feda8 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "cinder-quobyte-c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba" released by "delete_volume" :: held 1.528s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:09:53 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-06b479f6-e419-4a99-a188-d8cc314feda8 tempest-CreateVolumesFromImageTest-1222378736 None] Created reservations ['51d0a83f-6f22-4355-a15b-77f8efbaa065', 'a3086525-4cf3-44fa-a384-4c6ad71aedaa', '25f37509-3343-41ce-bdd3-228c51006b51', '76dc5214-447c-4e3e-bb80-f830fb92989a'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:09:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-06b479f6-e419-4a99-a188-d8cc314feda8 tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-06b479f6-e419-4a99-a188-d8cc314feda8 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:53 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-06b479f6-e419-4a99-a188-d8cc314feda8 tempest-CreateVolumesFromImageTest-1222378736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:09:53 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-06b479f6-e419-4a99-a188-d8cc314feda8 tempest-CreateVolumesFromImageTest-1222378736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:09:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-06b479f6-e419-4a99-a188-d8cc314feda8 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-06b479f6-e419-4a99-a188-d8cc314feda8 tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:53 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:09:53 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:53 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f967ac6f-2301-4cc7-bbf0-506e9d931caf tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "cinder-0c8a6e81-2577-4731-8a7e-d6820bd91ad7-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:09:53 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f967ac6f-2301-4cc7-bbf0-506e9d931caf tempest-CreateVolumesFromImageTest-1222378736 None] Lock "cinder-0c8a6e81-2577-4731-8a7e-d6820bd91ad7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:09:53 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f967ac6f-2301-4cc7-bbf0-506e9d931caf tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "cinder-quobyte-0c8a6e81-2577-4731-8a7e-d6820bd91ad7" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:09:53 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f967ac6f-2301-4cc7-bbf0-506e9d931caf tempest-CreateVolumesFromImageTest-1222378736 None] Lock "cinder-quobyte-0c8a6e81-2577-4731-8a7e-d6820bd91ad7" acquired by "delete_volume" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:09:53 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5990970a-657c-4215-be79-62d11f04304a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:09:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f967ac6f-2301-4cc7-bbf0-506e9d931caf tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0c8a6e81-2577-4731-8a7e-d6820bd91ad7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:53 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-06b479f6-e419-4a99-a188-d8cc314feda8 tempest-CreateVolumesFromImageTest-1222378736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.668s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:53 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-06b479f6-e419-4a99-a188-d8cc314feda8 tempest-CreateVolumesFromImageTest-1222378736 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:09:53 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-06b479f6-e419-4a99-a188-d8cc314feda8 tempest-CreateVolumesFromImageTest-1222378736 None] Deleted volume successfully. Jul 07 22:09:53 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-06b479f6-e419-4a99-a188-d8cc314feda8 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "cinder-c0f6c7bf-ec1b-4e85-9ab2-6161b18fedba-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:09:53 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0c8a6e81-2577-4731-8a7e-d6820bd91ad7 Jul 07 22:09:53 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:54 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f967ac6f-2301-4cc7-bbf0-506e9d931caf tempest-CreateVolumesFromImageTest-1222378736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0c8a6e81-2577-4731-8a7e-d6820bd91ad7" returned: 0 in 0.797s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f967ac6f-2301-4cc7-bbf0-506e9d931caf tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0c8a6e81-2577-4731-8a7e-d6820bd91ad7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:54 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0c8a6e81-2577-4731-8a7e-d6820bd91ad7 Jul 07 22:09:54 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:55 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f967ac6f-2301-4cc7-bbf0-506e9d931caf tempest-CreateVolumesFromImageTest-1222378736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0c8a6e81-2577-4731-8a7e-d6820bd91ad7" returned: 0 in 0.643s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:55 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f967ac6f-2301-4cc7-bbf0-506e9d931caf tempest-CreateVolumesFromImageTest-1222378736 None] Lock "cinder-quobyte-0c8a6e81-2577-4731-8a7e-d6820bd91ad7" released by "delete_volume" :: held 1.486s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:09:55 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-f967ac6f-2301-4cc7-bbf0-506e9d931caf tempest-CreateVolumesFromImageTest-1222378736 None] Created reservations ['a810acd8-3bdc-460e-b945-3055624b17a1', '93f4ceb1-f3db-4189-b261-65581569fcb9', '89ad6787-e027-44f0-919d-eadab5d17667', 'a5676d7d-dd05-4b29-a035-30b990eb97b3'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:09:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f967ac6f-2301-4cc7-bbf0-506e9d931caf tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f967ac6f-2301-4cc7-bbf0-506e9d931caf tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f967ac6f-2301-4cc7-bbf0-506e9d931caf tempest-CreateVolumesFromImageTest-1222378736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:09:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f967ac6f-2301-4cc7-bbf0-506e9d931caf tempest-CreateVolumesFromImageTest-1222378736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:09:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f967ac6f-2301-4cc7-bbf0-506e9d931caf tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f967ac6f-2301-4cc7-bbf0-506e9d931caf tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:55 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:09:55 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:55 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ca8bfa62-cb3b-4c22-9415-a7aea4382e60 tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "cinder-1a80933d-bf20-4df4-9a28-e586f25f464b-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:09:55 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ca8bfa62-cb3b-4c22-9415-a7aea4382e60 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "cinder-1a80933d-bf20-4df4-9a28-e586f25f464b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:09:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ca8bfa62-cb3b-4c22-9415-a7aea4382e60 tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "cinder-quobyte-1a80933d-bf20-4df4-9a28-e586f25f464b" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:09:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ca8bfa62-cb3b-4c22-9415-a7aea4382e60 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "cinder-quobyte-1a80933d-bf20-4df4-9a28-e586f25f464b" acquired by "delete_volume" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:09:56 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9043352b-c1f1-4294-867f-3ede5b47d84d]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:09:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ca8bfa62-cb3b-4c22-9415-a7aea4382e60 tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1a80933d-bf20-4df4-9a28-e586f25f464b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:56 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f967ac6f-2301-4cc7-bbf0-506e9d931caf tempest-CreateVolumesFromImageTest-1222378736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.736s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:56 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-f967ac6f-2301-4cc7-bbf0-506e9d931caf tempest-CreateVolumesFromImageTest-1222378736 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:09:56 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-f967ac6f-2301-4cc7-bbf0-506e9d931caf tempest-CreateVolumesFromImageTest-1222378736 None] Deleted volume successfully. Jul 07 22:09:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f967ac6f-2301-4cc7-bbf0-506e9d931caf tempest-CreateVolumesFromImageTest-1222378736 None] Lock "cinder-0c8a6e81-2577-4731-8a7e-d6820bd91ad7-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:09:56 devstack sudo[102647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1a80933d-bf20-4df4-9a28-e586f25f464b Jul 07 22:09:56 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:56 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ca8bfa62-cb3b-4c22-9415-a7aea4382e60 tempest-CreateVolumesFromImageTest-1222378736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1a80933d-bf20-4df4-9a28-e586f25f464b" returned: 0 in 0.788s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ca8bfa62-cb3b-4c22-9415-a7aea4382e60 tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1a80933d-bf20-4df4-9a28-e586f25f464b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:56 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1a80933d-bf20-4df4-9a28-e586f25f464b Jul 07 22:09:56 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:57 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ca8bfa62-cb3b-4c22-9415-a7aea4382e60 tempest-CreateVolumesFromImageTest-1222378736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1a80933d-bf20-4df4-9a28-e586f25f464b" returned: 0 in 0.617s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:57 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ca8bfa62-cb3b-4c22-9415-a7aea4382e60 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "cinder-quobyte-1a80933d-bf20-4df4-9a28-e586f25f464b" released by "delete_volume" :: held 1.449s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:09:57 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-ca8bfa62-cb3b-4c22-9415-a7aea4382e60 tempest-CreateVolumesFromImageTest-1222378736 None] Created reservations ['747d6b82-0c9f-4d5d-9000-45db704227a4', '888bf0ae-2bcb-4660-8d6c-d107dbeb7974', 'b71fa4cd-6c84-484d-8daf-0961036bc6a7', 'eeef32ec-6019-4202-8416-dfcc243c7bf0'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:09:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ca8bfa62-cb3b-4c22-9415-a7aea4382e60 tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ca8bfa62-cb3b-4c22-9415-a7aea4382e60 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ca8bfa62-cb3b-4c22-9415-a7aea4382e60 tempest-CreateVolumesFromImageTest-1222378736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:09:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ca8bfa62-cb3b-4c22-9415-a7aea4382e60 tempest-CreateVolumesFromImageTest-1222378736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:09:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ca8bfa62-cb3b-4c22-9415-a7aea4382e60 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ca8bfa62-cb3b-4c22-9415-a7aea4382e60 tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:57 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:09:57 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:58 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a0204b38-c738-4823-927b-5d260758511c tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "cinder-7beb6126-1aa7-44a9-a54c-5c1f1c587abe-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:09:58 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a0204b38-c738-4823-927b-5d260758511c tempest-CreateVolumesFromImageTest-1222378736 None] Lock "cinder-7beb6126-1aa7-44a9-a54c-5c1f1c587abe-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:09:58 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:58 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a0204b38-c738-4823-927b-5d260758511c tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "cinder-quobyte-7beb6126-1aa7-44a9-a54c-5c1f1c587abe" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:09:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ca8bfa62-cb3b-4c22-9415-a7aea4382e60 tempest-CreateVolumesFromImageTest-1222378736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.669s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:58 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-ca8bfa62-cb3b-4c22-9415-a7aea4382e60 tempest-CreateVolumesFromImageTest-1222378736 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:09:58 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ca8bfa62-cb3b-4c22-9415-a7aea4382e60 tempest-CreateVolumesFromImageTest-1222378736 None] Deleted volume successfully. Jul 07 22:09:58 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a0204b38-c738-4823-927b-5d260758511c tempest-CreateVolumesFromImageTest-1222378736 None] Lock "cinder-quobyte-7beb6126-1aa7-44a9-a54c-5c1f1c587abe" acquired by "delete_volume" :: waited 0.029s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:09:58 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ca8bfa62-cb3b-4c22-9415-a7aea4382e60 tempest-CreateVolumesFromImageTest-1222378736 None] Lock "cinder-1a80933d-bf20-4df4-9a28-e586f25f464b-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:09:58 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caa01a5-1215-4b02-9e17-96ce263dab6c]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:09:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a0204b38-c738-4823-927b-5d260758511c tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7beb6126-1aa7-44a9-a54c-5c1f1c587abe {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:58 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7beb6126-1aa7-44a9-a54c-5c1f1c587abe Jul 07 22:09:58 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:59 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a0204b38-c738-4823-927b-5d260758511c tempest-CreateVolumesFromImageTest-1222378736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7beb6126-1aa7-44a9-a54c-5c1f1c587abe" returned: 0 in 0.783s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a0204b38-c738-4823-927b-5d260758511c tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7beb6126-1aa7-44a9-a54c-5c1f1c587abe {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:59 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7beb6126-1aa7-44a9-a54c-5c1f1c587abe Jul 07 22:09:59 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:09:59 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Jul 07 22:09:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a0204b38-c738-4823-927b-5d260758511c tempest-CreateVolumesFromImageTest-1222378736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7beb6126-1aa7-44a9-a54c-5c1f1c587abe" returned: 0 in 0.672s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:09:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a0204b38-c738-4823-927b-5d260758511c tempest-CreateVolumesFromImageTest-1222378736 None] Lock "cinder-quobyte-7beb6126-1aa7-44a9-a54c-5c1f1c587abe" released by "delete_volume" :: held 1.495s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:09:59 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-a0204b38-c738-4823-927b-5d260758511c tempest-CreateVolumesFromImageTest-1222378736 None] Created reservations ['d7b6a75e-458b-4614-9387-186b325af806', 'b663da01-aab8-4418-bd8a-3d367df16d17', '16898de4-a09d-4c02-8fc6-2efb690bef85', 'd5b952d4-9b4c-4cba-b4ba-4780fc7dd337'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:09:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a0204b38-c738-4823-927b-5d260758511c tempest-CreateVolumesFromImageTest-1222378736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:09:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a0204b38-c738-4823-927b-5d260758511c tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:09:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a0204b38-c738-4823-927b-5d260758511c tempest-CreateVolumesFromImageTest-1222378736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:09:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a0204b38-c738-4823-927b-5d260758511c tempest-CreateVolumesFromImageTest-1222378736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:09:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a0204b38-c738-4823-927b-5d260758511c tempest-CreateVolumesFromImageTest-1222378736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:09:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a0204b38-c738-4823-927b-5d260758511c tempest-CreateVolumesFromImageTest-1222378736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:09:59 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:09:59 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:00 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a0204b38-c738-4823-927b-5d260758511c tempest-CreateVolumesFromImageTest-1222378736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.674s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:00 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-a0204b38-c738-4823-927b-5d260758511c tempest-CreateVolumesFromImageTest-1222378736 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:10:00 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-a0204b38-c738-4823-927b-5d260758511c tempest-CreateVolumesFromImageTest-1222378736 None] Deleted volume successfully. Jul 07 22:10:00 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a0204b38-c738-4823-927b-5d260758511c tempest-CreateVolumesFromImageTest-1222378736 None] Lock "cinder-7beb6126-1aa7-44a9-a54c-5c1f1c587abe-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:10:03 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:10:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Flow 'volume_create_manager' (7f41b90d-969b-434b-ac99-a91f927853e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:10:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94623908-89ea-4965-a188-c43d3171b7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94623908-89ea-4965-a188-c43d3171b7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2066849780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc973b3f-0636-409d-8ad0-00aeaf0ef28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81739d7ae5324ef8b3f560911a582cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:10:03Z,use_quota=True,user_id='515561b4d66d497892f1665049e4ce01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487f0455-73ca-412b-8ee7-c402280799ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487f0455-73ca-412b-8ee7-c402280799ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a14bfd7-d956-4d6e-bdb3-508d3ac393f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a14bfd7-d956-4d6e-bdb3-508d3ac393f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc973b3f-0636-409d-8ad0-00aeaf0ef28b', 'volume_name': 'volume-bc973b3f-0636-409d-8ad0-00aeaf0ef28b', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d29e145-c3f5-48b5-aaca-2e8b291585ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d29e145-c3f5-48b5-aaca-2e8b291585ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb924ef7-a80a-479c-a23c-e835d4097bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:03 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Volume bc973b3f-0636-409d-8ad0-00aeaf0ef28b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc973b3f-0636-409d-8ad0-00aeaf0ef28b', 'volume_size': 1} Jul 07 22:10:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2066849780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc973b3f-0636-409d-8ad0-00aeaf0ef28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81739d7ae5324ef8b3f560911a582cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:10:03Z,use_quota=True,user_id='515561b4d66d497892f1665049e4ce01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:10:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Creating volume bc973b3f-0636-409d-8ad0-00aeaf0ef28b {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:10:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:10:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:10:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:10:03 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:10:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bc973b3f-0636-409d-8ad0-00aeaf0ef28b 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:03 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bc973b3f-0636-409d-8ad0-00aeaf0ef28b 1073741824 Jul 07 22:10:03 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:04 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bc973b3f-0636-409d-8ad0-00aeaf0ef28b 1073741824" returned: 0 in 0.907s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bc973b3f-0636-409d-8ad0-00aeaf0ef28b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:04 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bc973b3f-0636-409d-8ad0-00aeaf0ef28b Jul 07 22:10:04 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:04 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bc973b3f-0636-409d-8ad0-00aeaf0ef28b" returned: 0 in 0.695s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:04 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:10:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb924ef7-a80a-479c-a23c-e835d4097bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc973b3f-0636-409d-8ad0-00aeaf0ef28b', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe222f1-45cc-45e8-887f-3e4f7521f4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:05 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Volume volume-bc973b3f-0636-409d-8ad0-00aeaf0ef28b (bc973b3f-0636-409d-8ad0-00aeaf0ef28b): created successfully Jul 07 22:10:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe222f1-45cc-45e8-887f-3e4f7521f4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Flow 'volume_create_manager' (7f41b90d-969b-434b-ac99-a91f927853e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:10:05 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-bc89c7a5-88b2-435d-98c3-bdf9624f6301 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Created volume successfully. Jul 07 22:10:05 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:10:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Flow 'volume_create_manager' (84a98f8f-b8cb-497e-a34a-b0354da45586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:10:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57960384-fce9-4154-b970-62b134832cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57960384-fce9-4154-b970-62b134832cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-757488049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7499ac7-098d-48b5-adc7-383a36a887f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81739d7ae5324ef8b3f560911a582cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:10:06Z,use_quota=True,user_id='515561b4d66d497892f1665049e4ce01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d91782-4c68-492c-82dc-cb4c48a93957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d91782-4c68-492c-82dc-cb4c48a93957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d079b2e8-99fa-4dec-a6f2-d0028c54f245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d079b2e8-99fa-4dec-a6f2-d0028c54f245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7499ac7-098d-48b5-adc7-383a36a887f8', 'volume_name': 'volume-b7499ac7-098d-48b5-adc7-383a36a887f8', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebeee26-556e-4869-9d67-4b2b4031230a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebeee26-556e-4869-9d67-4b2b4031230a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0a044f-97b6-42fb-ab0a-2c511f33c9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:06 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Volume b7499ac7-098d-48b5-adc7-383a36a887f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7499ac7-098d-48b5-adc7-383a36a887f8', 'volume_size': 1} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-757488049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7499ac7-098d-48b5-adc7-383a36a887f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81739d7ae5324ef8b3f560911a582cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:10:06Z,use_quota=True,user_id='515561b4d66d497892f1665049e4ce01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Creating volume b7499ac7-098d-48b5-adc7-383a36a887f8 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:10:06 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b7499ac7-098d-48b5-adc7-383a36a887f8 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:06 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b7499ac7-098d-48b5-adc7-383a36a887f8 1073741824 Jul 07 22:10:06 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Flow 'volume_create_manager' (85c2632b-661b-4979-88b5-455b3e83e2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1177d2-811e-43ad-abd9-84534cc5c3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1177d2-811e-43ad-abd9-84534cc5c3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1272410706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e795ed7-456e-4dcd-9498-850e1a1f79f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81739d7ae5324ef8b3f560911a582cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:10:06Z,use_quota=True,user_id='515561b4d66d497892f1665049e4ce01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70b579f-4f26-4dea-9040-3c5e01777fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70b579f-4f26-4dea-9040-3c5e01777fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd9e3de-7342-4997-9827-404f04a7aba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd9e3de-7342-4997-9827-404f04a7aba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e795ed7-456e-4dcd-9498-850e1a1f79f7', 'volume_name': 'volume-8e795ed7-456e-4dcd-9498-850e1a1f79f7', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7abb99c7-d74d-46da-bc9a-7fdd0a928352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7abb99c7-d74d-46da-bc9a-7fdd0a928352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70108792-f428-440e-8706-2c113bc964b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:06 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Volume 8e795ed7-456e-4dcd-9498-850e1a1f79f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e795ed7-456e-4dcd-9498-850e1a1f79f7', 'volume_size': 1} Jul 07 22:10:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:07 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b7499ac7-098d-48b5-adc7-383a36a887f8 1073741824" returned: 0 in 1.117s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b7499ac7-098d-48b5-adc7-383a36a887f8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:10:07 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b7499ac7-098d-48b5-adc7-383a36a887f8 Jul 07 22:10:07 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Flow 'volume_create_manager' (b44f8e71-fec1-4dcb-991c-f3e52e8500bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2254a6c-9138-4aff-867d-34894860bf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2254a6c-9138-4aff-867d-34894860bf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1453115040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=926d352b-18f7-4506-a35c-5e9658cee520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81739d7ae5324ef8b3f560911a582cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:10:07Z,use_quota=True,user_id='515561b4d66d497892f1665049e4ce01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e02574a-07f6-4559-b3e5-a4f4d04fba8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e02574a-07f6-4559-b3e5-a4f4d04fba8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e98461e-a5a5-4fc7-bbaf-2645c62384ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e98461e-a5a5-4fc7-bbaf-2645c62384ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '926d352b-18f7-4506-a35c-5e9658cee520', 'volume_name': 'volume-926d352b-18f7-4506-a35c-5e9658cee520', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7add73a1-d337-4eb0-bd80-366cd6cc12f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7add73a1-d337-4eb0-bd80-366cd6cc12f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda1e40a-dcd7-4cc8-95e8-88ba6d6be383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:07 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Volume 926d352b-18f7-4506-a35c-5e9658cee520: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-926d352b-18f7-4506-a35c-5e9658cee520', 'volume_size': 1} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Flow 'volume_create_manager' (567441d2-965b-4f82-a591-f76b2df541ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943ba40d-5067-4eab-b6da-e10ba0edfc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943ba40d-5067-4eab-b6da-e10ba0edfc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1865910289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb0a276-59f0-47cf-96cf-79dff8d2ffdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81739d7ae5324ef8b3f560911a582cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:10:08Z,use_quota=True,user_id='515561b4d66d497892f1665049e4ce01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7da009-4fad-4f61-b3bc-571018e93016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7da009-4fad-4f61-b3bc-571018e93016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8992f3b-a55e-4ca7-ba0a-44df4d59f53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8992f3b-a55e-4ca7-ba0a-44df4d59f53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bb0a276-59f0-47cf-96cf-79dff8d2ffdc', 'volume_name': 'volume-8bb0a276-59f0-47cf-96cf-79dff8d2ffdc', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b1f8fa-9cfe-4395-861b-3ee1ea40f36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b1f8fa-9cfe-4395-861b-3ee1ea40f36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49791c6e-c0a9-4d69-a140-45db42ae9ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:07 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Volume 8bb0a276-59f0-47cf-96cf-79dff8d2ffdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bb0a276-59f0-47cf-96cf-79dff8d2ffdc', 'volume_size': 1} Jul 07 22:10:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:08 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-7c47e5d0-ec09-4d14-a72a-9fd5f7be5096 req-cb242984-d3d6-4e2f-ac31-f54aebb7d6c0 tempest-TestMinimumBasicScenario-491090470 None] Terminate volume connection completed successfully. Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-7c47e5d0-ec09-4d14-a72a-9fd5f7be5096 req-cb242984-d3d6-4e2f-ac31-f54aebb7d6c0 tempest-TestMinimumBasicScenario-491090470 None] Deleting attachment dc51cffb-4890-407e-81bc-bfcf6f373373. {{(pid=87586) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 07 22:10:08 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Flow 'volume_create_manager' (5aa59e01-9676-4e24-be0e-a3f9e996de92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (982af420-6090-4c2d-957f-7942ce0a614a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b7499ac7-098d-48b5-adc7-383a36a887f8" returned: 0 in 0.923s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.108s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.524s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1272410706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e795ed7-456e-4dcd-9498-850e1a1f79f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81739d7ae5324ef8b3f560911a582cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:10:06Z,use_quota=True,user_id='515561b4d66d497892f1665049e4ce01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Creating volume 8e795ed7-456e-4dcd-9498-850e1a1f79f7 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:10:08 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8e795ed7-456e-4dcd-9498-850e1a1f79f7 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (982af420-6090-4c2d-957f-7942ce0a614a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1288609679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc8277e1-b300-49f2-bf40-4d7e35ea24cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81739d7ae5324ef8b3f560911a582cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:10:08Z,use_quota=True,user_id='515561b4d66d497892f1665049e4ce01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:08 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8e795ed7-456e-4dcd-9498-850e1a1f79f7 1073741824 Jul 07 22:10:08 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1954f88d-a932-4ed0-a186-65624caf7bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1954f88d-a932-4ed0-a186-65624caf7bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e907dfcd-1f39-4b07-bdf3-8aea5f3bfa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e907dfcd-1f39-4b07-bdf3-8aea5f3bfa54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc8277e1-b300-49f2-bf40-4d7e35ea24cc', 'volume_name': 'volume-dc8277e1-b300-49f2-bf40-4d7e35ea24cc', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d377fbb-7daf-4917-b6cb-bff508e808fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d377fbb-7daf-4917-b6cb-bff508e808fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e60cec-46bd-4ab0-9813-f60296bf4ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:08 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Volume dc8277e1-b300-49f2-bf40-4d7e35ea24cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc8277e1-b300-49f2-bf40-4d7e35ea24cc', 'volume_size': 1} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0a044f-97b6-42fb-ab0a-2c511f33c9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7499ac7-098d-48b5-adc7-383a36a887f8', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de5efc2-430a-4024-b0f4-286fe8b97ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:08 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Volume volume-b7499ac7-098d-48b5-adc7-383a36a887f8 (b7499ac7-098d-48b5-adc7-383a36a887f8): created successfully Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de5efc2-430a-4024-b0f4-286fe8b97ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:08 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Flow 'volume_create_manager' (84a98f8f-b8cb-497e-a34a-b0354da45586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:10:08 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-380322c8-169f-4052-8d54-bc5d059cbcad tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Created volume successfully. Jul 07 22:10:09 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8e795ed7-456e-4dcd-9498-850e1a1f79f7 1073741824" returned: 0 in 0.870s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8e795ed7-456e-4dcd-9498-850e1a1f79f7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:09 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8e795ed7-456e-4dcd-9498-850e1a1f79f7 Jul 07 22:10:09 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:09 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8e795ed7-456e-4dcd-9498-850e1a1f79f7" returned: 0 in 0.642s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:10:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.383s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1453115040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=926d352b-18f7-4506-a35c-5e9658cee520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81739d7ae5324ef8b3f560911a582cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:10:07Z,use_quota=True,user_id='515561b4d66d497892f1665049e4ce01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:10:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Creating volume 926d352b-18f7-4506-a35c-5e9658cee520 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:10:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:10:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:10:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:10:09 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:10:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-926d352b-18f7-4506-a35c-5e9658cee520 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70108792-f428-440e-8706-2c113bc964b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e795ed7-456e-4dcd-9498-850e1a1f79f7', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:09 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-926d352b-18f7-4506-a35c-5e9658cee520 1073741824 Jul 07 22:10:09 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0950eadb-cc11-40ab-888e-3eb84459b993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:09 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Volume volume-8e795ed7-456e-4dcd-9498-850e1a1f79f7 (8e795ed7-456e-4dcd-9498-850e1a1f79f7): created successfully Jul 07 22:10:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0950eadb-cc11-40ab-888e-3eb84459b993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Flow 'volume_create_manager' (85c2632b-661b-4979-88b5-455b3e83e2b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:10:09 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-b0bb8e85-855e-4a5d-a3ed-83d649e61cc5 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Created volume successfully. Jul 07 22:10:10 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-98a85a18-8809-4690-ae20-d938dd3d45ce tempest-TestMinimumBasicScenario-491090470 None] Acquiring lock "cinder-4bd7c20c-6375-4c99-adda-00337c8c5816-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:10:10 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-98a85a18-8809-4690-ae20-d938dd3d45ce tempest-TestMinimumBasicScenario-491090470 None] Lock "cinder-4bd7c20c-6375-4c99-adda-00337c8c5816-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:10:10 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-98a85a18-8809-4690-ae20-d938dd3d45ce tempest-TestMinimumBasicScenario-491090470 None] Acquiring lock "cinder-quobyte-4bd7c20c-6375-4c99-adda-00337c8c5816" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:10:10 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-98a85a18-8809-4690-ae20-d938dd3d45ce tempest-TestMinimumBasicScenario-491090470 None] Lock "cinder-quobyte-4bd7c20c-6375-4c99-adda-00337c8c5816" acquired by "delete_volume" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:10:10 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8602c6e0-1127-4886-9f02-a23de6ce6eef]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:10:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-98a85a18-8809-4690-ae20-d938dd3d45ce tempest-TestMinimumBasicScenario-491090470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4bd7c20c-6375-4c99-adda-00337c8c5816 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:10 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4bd7c20c-6375-4c99-adda-00337c8c5816 Jul 07 22:10:10 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:10 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-926d352b-18f7-4506-a35c-5e9658cee520 1073741824" returned: 0 in 0.862s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-926d352b-18f7-4506-a35c-5e9658cee520 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:10 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-926d352b-18f7-4506-a35c-5e9658cee520 Jul 07 22:10:10 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:10 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-98a85a18-8809-4690-ae20-d938dd3d45ce tempest-TestMinimumBasicScenario-491090470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4bd7c20c-6375-4c99-adda-00337c8c5816" returned: 0 in 0.795s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-98a85a18-8809-4690-ae20-d938dd3d45ce tempest-TestMinimumBasicScenario-491090470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4bd7c20c-6375-4c99-adda-00337c8c5816 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:10 devstack sudo[102720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4bd7c20c-6375-4c99-adda-00337c8c5816 Jul 07 22:10:10 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:11 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-926d352b-18f7-4506-a35c-5e9658cee520" returned: 0 in 0.730s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.629s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1865910289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb0a276-59f0-47cf-96cf-79dff8d2ffdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81739d7ae5324ef8b3f560911a582cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:10:08Z,use_quota=True,user_id='515561b4d66d497892f1665049e4ce01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Creating volume 8bb0a276-59f0-47cf-96cf-79dff8d2ffdc {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:10:11 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bb0a276-59f0-47cf-96cf-79dff8d2ffdc 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda1e40a-dcd7-4cc8-95e8-88ba6d6be383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-926d352b-18f7-4506-a35c-5e9658cee520', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:11 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bb0a276-59f0-47cf-96cf-79dff8d2ffdc 1073741824 Jul 07 22:10:11 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e3ab7a0-5262-4e1f-be19-a554432ab3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:11 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Volume volume-926d352b-18f7-4506-a35c-5e9658cee520 (926d352b-18f7-4506-a35c-5e9658cee520): created successfully Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e3ab7a0-5262-4e1f-be19-a554432ab3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Flow 'volume_create_manager' (b44f8e71-fec1-4dcb-991c-f3e52e8500bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:10:11 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-a87b4cf3-173a-4226-ad41-4220ca97539e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Created volume successfully. Jul 07 22:10:11 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-98a85a18-8809-4690-ae20-d938dd3d45ce tempest-TestMinimumBasicScenario-491090470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4bd7c20c-6375-4c99-adda-00337c8c5816" returned: 0 in 0.710s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-98a85a18-8809-4690-ae20-d938dd3d45ce tempest-TestMinimumBasicScenario-491090470 None] Lock "cinder-quobyte-4bd7c20c-6375-4c99-adda-00337c8c5816" released by "delete_volume" :: held 1.555s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-98a85a18-8809-4690-ae20-d938dd3d45ce tempest-TestMinimumBasicScenario-491090470 None] Created reservations ['445350a2-e8fa-499d-a056-ffd8fc343db0', '3060e93e-7457-4f3c-9b56-9c052e618940', '866ae274-4c80-4b7a-8101-924ecf889cb4', '79b022a8-8c1a-4005-9d2d-7ff5e7ceb2fb'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-98a85a18-8809-4690-ae20-d938dd3d45ce tempest-TestMinimumBasicScenario-491090470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-98a85a18-8809-4690-ae20-d938dd3d45ce tempest-TestMinimumBasicScenario-491090470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-98a85a18-8809-4690-ae20-d938dd3d45ce tempest-TestMinimumBasicScenario-491090470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-98a85a18-8809-4690-ae20-d938dd3d45ce tempest-TestMinimumBasicScenario-491090470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-98a85a18-8809-4690-ae20-d938dd3d45ce tempest-TestMinimumBasicScenario-491090470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-98a85a18-8809-4690-ae20-d938dd3d45ce tempest-TestMinimumBasicScenario-491090470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:11 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:10:11 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:12 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bb0a276-59f0-47cf-96cf-79dff8d2ffdc 1073741824" returned: 0 in 0.959s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bb0a276-59f0-47cf-96cf-79dff8d2ffdc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:12 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bb0a276-59f0-47cf-96cf-79dff8d2ffdc Jul 07 22:10:12 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:12 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-98a85a18-8809-4690-ae20-d938dd3d45ce tempest-TestMinimumBasicScenario-491090470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.731s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:12 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-98a85a18-8809-4690-ae20-d938dd3d45ce tempest-TestMinimumBasicScenario-491090470 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:10:12 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-98a85a18-8809-4690-ae20-d938dd3d45ce tempest-TestMinimumBasicScenario-491090470 None] Deleted volume successfully. Jul 07 22:10:12 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-98a85a18-8809-4690-ae20-d938dd3d45ce tempest-TestMinimumBasicScenario-491090470 None] Lock "cinder-4bd7c20c-6375-4c99-adda-00337c8c5816-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:10:13 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bb0a276-59f0-47cf-96cf-79dff8d2ffdc" returned: 0 in 0.695s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:10:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.875s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1288609679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc8277e1-b300-49f2-bf40-4d7e35ea24cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81739d7ae5324ef8b3f560911a582cf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:10:08Z,use_quota=True,user_id='515561b4d66d497892f1665049e4ce01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:10:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Creating volume dc8277e1-b300-49f2-bf40-4d7e35ea24cc {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:10:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:10:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:10:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:10:13 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:10:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dc8277e1-b300-49f2-bf40-4d7e35ea24cc 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:13 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dc8277e1-b300-49f2-bf40-4d7e35ea24cc 1073741824 Jul 07 22:10:13 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49791c6e-c0a9-4d69-a140-45db42ae9ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bb0a276-59f0-47cf-96cf-79dff8d2ffdc', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3928a10-8a76-49e9-b7b1-5ab654e9f27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:13 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Volume volume-8bb0a276-59f0-47cf-96cf-79dff8d2ffdc (8bb0a276-59f0-47cf-96cf-79dff8d2ffdc): created successfully Jul 07 22:10:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3928a10-8a76-49e9-b7b1-5ab654e9f27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Flow 'volume_create_manager' (567441d2-965b-4f82-a591-f76b2df541ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:10:13 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-799c263d-8fa2-474d-b2c1-081120a1a77a tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Created volume successfully. Jul 07 22:10:13 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dc8277e1-b300-49f2-bf40-4d7e35ea24cc 1073741824" returned: 0 in 0.812s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dc8277e1-b300-49f2-bf40-4d7e35ea24cc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:13 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dc8277e1-b300-49f2-bf40-4d7e35ea24cc Jul 07 22:10:13 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:14 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dc8277e1-b300-49f2-bf40-4d7e35ea24cc" returned: 0 in 0.766s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:10:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e60cec-46bd-4ab0-9813-f60296bf4ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc8277e1-b300-49f2-bf40-4d7e35ea24cc', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f11309c-105a-4391-801d-47e1f4a9e1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:14 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Volume volume-dc8277e1-b300-49f2-bf40-4d7e35ea24cc (dc8277e1-b300-49f2-bf40-4d7e35ea24cc): created successfully Jul 07 22:10:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f11309c-105a-4391-801d-47e1f4a9e1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Flow 'volume_create_manager' (5aa59e01-9676-4e24-be0e-a3f9e996de92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:10:14 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-9f28072a-72e2-4876-8bb1-e400d98ea997 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Created volume successfully. Jul 07 22:10:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-75284e4b-8797-4bc6-8b8e-c2cdf67a647e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "cinder-dc8277e1-b300-49f2-bf40-4d7e35ea24cc-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:10:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-75284e4b-8797-4bc6-8b8e-c2cdf67a647e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-dc8277e1-b300-49f2-bf40-4d7e35ea24cc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:10:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-75284e4b-8797-4bc6-8b8e-c2cdf67a647e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "cinder-quobyte-dc8277e1-b300-49f2-bf40-4d7e35ea24cc" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:10:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-75284e4b-8797-4bc6-8b8e-c2cdf67a647e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-quobyte-dc8277e1-b300-49f2-bf40-4d7e35ea24cc" acquired by "delete_volume" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:10:15 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60231cd-a5d1-4115-8d51-1d6abb81e27c]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:10:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-75284e4b-8797-4bc6-8b8e-c2cdf67a647e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dc8277e1-b300-49f2-bf40-4d7e35ea24cc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:15 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dc8277e1-b300-49f2-bf40-4d7e35ea24cc Jul 07 22:10:15 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:16 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-75284e4b-8797-4bc6-8b8e-c2cdf67a647e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dc8277e1-b300-49f2-bf40-4d7e35ea24cc" returned: 0 in 0.743s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-75284e4b-8797-4bc6-8b8e-c2cdf67a647e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dc8277e1-b300-49f2-bf40-4d7e35ea24cc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:16 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dc8277e1-b300-49f2-bf40-4d7e35ea24cc Jul 07 22:10:16 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:17 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-75284e4b-8797-4bc6-8b8e-c2cdf67a647e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dc8277e1-b300-49f2-bf40-4d7e35ea24cc" returned: 0 in 0.654s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:17 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-75284e4b-8797-4bc6-8b8e-c2cdf67a647e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-quobyte-dc8277e1-b300-49f2-bf40-4d7e35ea24cc" released by "delete_volume" :: held 1.437s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:10:17 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-75284e4b-8797-4bc6-8b8e-c2cdf67a647e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Created reservations ['8ddc5966-e625-485d-9624-54fc81ff24cf', 'f42f78ce-f198-47e9-be34-72e18a95ef73', 'bfefcad1-38ec-464a-8d53-48c2ae645d61', 'cae9677d-c561-4fa0-ab54-d330c98bacb4'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:10:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-75284e4b-8797-4bc6-8b8e-c2cdf67a647e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-75284e4b-8797-4bc6-8b8e-c2cdf67a647e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:17 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-75284e4b-8797-4bc6-8b8e-c2cdf67a647e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:10:17 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-75284e4b-8797-4bc6-8b8e-c2cdf67a647e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:10:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-75284e4b-8797-4bc6-8b8e-c2cdf67a647e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-75284e4b-8797-4bc6-8b8e-c2cdf67a647e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:17 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:10:17 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-95b9d04e-e5b1-499e-8bce-e589b9171853 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "cinder-8bb0a276-59f0-47cf-96cf-79dff8d2ffdc-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:10:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-95b9d04e-e5b1-499e-8bce-e589b9171853 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-8bb0a276-59f0-47cf-96cf-79dff8d2ffdc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:10:18 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-75284e4b-8797-4bc6-8b8e-c2cdf67a647e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.650s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:18 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-75284e4b-8797-4bc6-8b8e-c2cdf67a647e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:10:18 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-75284e4b-8797-4bc6-8b8e-c2cdf67a647e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Deleted volume successfully. Jul 07 22:10:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-75284e4b-8797-4bc6-8b8e-c2cdf67a647e tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-dc8277e1-b300-49f2-bf40-4d7e35ea24cc-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:10:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-95b9d04e-e5b1-499e-8bce-e589b9171853 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "cinder-quobyte-8bb0a276-59f0-47cf-96cf-79dff8d2ffdc" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:10:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-95b9d04e-e5b1-499e-8bce-e589b9171853 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-quobyte-8bb0a276-59f0-47cf-96cf-79dff8d2ffdc" acquired by "delete_volume" :: waited 0.013s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:10:18 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aaed8a-b3cc-4ebc-880a-99975834c3ed]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:10:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-95b9d04e-e5b1-499e-8bce-e589b9171853 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bb0a276-59f0-47cf-96cf-79dff8d2ffdc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:18 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bb0a276-59f0-47cf-96cf-79dff8d2ffdc Jul 07 22:10:18 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:18 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-95b9d04e-e5b1-499e-8bce-e589b9171853 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bb0a276-59f0-47cf-96cf-79dff8d2ffdc" returned: 0 in 0.749s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-95b9d04e-e5b1-499e-8bce-e589b9171853 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bb0a276-59f0-47cf-96cf-79dff8d2ffdc {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:18 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bb0a276-59f0-47cf-96cf-79dff8d2ffdc Jul 07 22:10:18 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:19 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-95b9d04e-e5b1-499e-8bce-e589b9171853 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8bb0a276-59f0-47cf-96cf-79dff8d2ffdc" returned: 0 in 0.659s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-95b9d04e-e5b1-499e-8bce-e589b9171853 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-quobyte-8bb0a276-59f0-47cf-96cf-79dff8d2ffdc" released by "delete_volume" :: held 1.445s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:10:19 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-95b9d04e-e5b1-499e-8bce-e589b9171853 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Created reservations ['179d8a07-b764-415c-bf1a-38f718926e0c', 'bb8b5c93-7b04-42ee-9133-cda5c6521998', 'f8359e28-9d0a-4668-9d57-4388692f0396', '7c5b9a4a-5f40-481c-80fa-fbca94a9bb17'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:10:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-95b9d04e-e5b1-499e-8bce-e589b9171853 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-95b9d04e-e5b1-499e-8bce-e589b9171853 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-95b9d04e-e5b1-499e-8bce-e589b9171853 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:10:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-95b9d04e-e5b1-499e-8bce-e589b9171853 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:10:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-95b9d04e-e5b1-499e-8bce-e589b9171853 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-95b9d04e-e5b1-499e-8bce-e589b9171853 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:19 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:10:19 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5afe0a02-d0ec-4c37-acbf-83737582056f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "cinder-926d352b-18f7-4506-a35c-5e9658cee520-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:10:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5afe0a02-d0ec-4c37-acbf-83737582056f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-926d352b-18f7-4506-a35c-5e9658cee520-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:10:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5afe0a02-d0ec-4c37-acbf-83737582056f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "cinder-quobyte-926d352b-18f7-4506-a35c-5e9658cee520" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:10:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5afe0a02-d0ec-4c37-acbf-83737582056f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-quobyte-926d352b-18f7-4506-a35c-5e9658cee520" acquired by "delete_volume" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:10:20 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:20 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6e9e5f-6147-49cf-aa58-f08520c37864]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:10:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5afe0a02-d0ec-4c37-acbf-83737582056f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-926d352b-18f7-4506-a35c-5e9658cee520 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-95b9d04e-e5b1-499e-8bce-e589b9171853 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.716s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:20 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-95b9d04e-e5b1-499e-8bce-e589b9171853 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:10:20 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-95b9d04e-e5b1-499e-8bce-e589b9171853 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Deleted volume successfully. Jul 07 22:10:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-95b9d04e-e5b1-499e-8bce-e589b9171853 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-8bb0a276-59f0-47cf-96cf-79dff8d2ffdc-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:10:20 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-926d352b-18f7-4506-a35c-5e9658cee520 Jul 07 22:10:20 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:21 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5afe0a02-d0ec-4c37-acbf-83737582056f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-926d352b-18f7-4506-a35c-5e9658cee520" returned: 0 in 0.803s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5afe0a02-d0ec-4c37-acbf-83737582056f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-926d352b-18f7-4506-a35c-5e9658cee520 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:21 devstack sudo[102799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-926d352b-18f7-4506-a35c-5e9658cee520 Jul 07 22:10:21 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:21 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5afe0a02-d0ec-4c37-acbf-83737582056f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-926d352b-18f7-4506-a35c-5e9658cee520" returned: 0 in 0.683s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:21 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5afe0a02-d0ec-4c37-acbf-83737582056f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-quobyte-926d352b-18f7-4506-a35c-5e9658cee520" released by "delete_volume" :: held 1.533s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:10:21 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-5afe0a02-d0ec-4c37-acbf-83737582056f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Created reservations ['52199d94-4ced-49c3-8d15-750c091ac74f', '3960a65b-56f1-4495-9de3-b296586ad71d', 'ad3adb02-abca-4636-8922-878c43f90759', '9f873497-ec37-4dc4-84c4-59378958abfe'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:10:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5afe0a02-d0ec-4c37-acbf-83737582056f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5afe0a02-d0ec-4c37-acbf-83737582056f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5afe0a02-d0ec-4c37-acbf-83737582056f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:10:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5afe0a02-d0ec-4c37-acbf-83737582056f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:10:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5afe0a02-d0ec-4c37-acbf-83737582056f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5afe0a02-d0ec-4c37-acbf-83737582056f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:22 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:10:22 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-269cc56e-bd70-43c0-abbe-434b5175933f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "cinder-8e795ed7-456e-4dcd-9498-850e1a1f79f7-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:10:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-269cc56e-bd70-43c0-abbe-434b5175933f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-8e795ed7-456e-4dcd-9498-850e1a1f79f7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:10:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-269cc56e-bd70-43c0-abbe-434b5175933f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "cinder-quobyte-8e795ed7-456e-4dcd-9498-850e1a1f79f7" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:10:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-269cc56e-bd70-43c0-abbe-434b5175933f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-quobyte-8e795ed7-456e-4dcd-9498-850e1a1f79f7" acquired by "delete_volume" :: waited 0.026s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:10:22 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2ad96a-3d0d-487b-8686-6d9f911d1405]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:10:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-269cc56e-bd70-43c0-abbe-434b5175933f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8e795ed7-456e-4dcd-9498-850e1a1f79f7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:22 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8e795ed7-456e-4dcd-9498-850e1a1f79f7 Jul 07 22:10:22 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:22 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5afe0a02-d0ec-4c37-acbf-83737582056f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.833s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:22 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-5afe0a02-d0ec-4c37-acbf-83737582056f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:10:22 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-5afe0a02-d0ec-4c37-acbf-83737582056f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Deleted volume successfully. Jul 07 22:10:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5afe0a02-d0ec-4c37-acbf-83737582056f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-926d352b-18f7-4506-a35c-5e9658cee520-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:10:23 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-269cc56e-bd70-43c0-abbe-434b5175933f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8e795ed7-456e-4dcd-9498-850e1a1f79f7" returned: 0 in 0.911s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-269cc56e-bd70-43c0-abbe-434b5175933f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8e795ed7-456e-4dcd-9498-850e1a1f79f7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:23 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8e795ed7-456e-4dcd-9498-850e1a1f79f7 Jul 07 22:10:23 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:24 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-269cc56e-bd70-43c0-abbe-434b5175933f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8e795ed7-456e-4dcd-9498-850e1a1f79f7" returned: 0 in 0.737s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-269cc56e-bd70-43c0-abbe-434b5175933f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-quobyte-8e795ed7-456e-4dcd-9498-850e1a1f79f7" released by "delete_volume" :: held 1.699s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:10:24 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-269cc56e-bd70-43c0-abbe-434b5175933f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Created reservations ['4dbbef97-050c-4096-8729-6e2017ce0405', '7c1a999a-f6cd-48dc-8191-7738f1f78c4f', 'cce8d9d8-f3e1-496d-9066-94e528aeea76', 'c0dce980-3b6c-4220-9424-d1f76d0c6f9d'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:10:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-269cc56e-bd70-43c0-abbe-434b5175933f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-269cc56e-bd70-43c0-abbe-434b5175933f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-269cc56e-bd70-43c0-abbe-434b5175933f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:10:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-269cc56e-bd70-43c0-abbe-434b5175933f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:10:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-269cc56e-bd70-43c0-abbe-434b5175933f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-269cc56e-bd70-43c0-abbe-434b5175933f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:24 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:10:24 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5e944c4a-0692-474e-9b4d-7e2986ad8025 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "cinder-b7499ac7-098d-48b5-adc7-383a36a887f8-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:10:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5e944c4a-0692-474e-9b4d-7e2986ad8025 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-b7499ac7-098d-48b5-adc7-383a36a887f8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:10:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5e944c4a-0692-474e-9b4d-7e2986ad8025 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "cinder-quobyte-b7499ac7-098d-48b5-adc7-383a36a887f8" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:10:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5e944c4a-0692-474e-9b4d-7e2986ad8025 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-quobyte-b7499ac7-098d-48b5-adc7-383a36a887f8" acquired by "delete_volume" :: waited 0.035s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:10:24 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d46bd4-1ea4-465c-a78c-4b3728fedea9]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:10:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5e944c4a-0692-474e-9b4d-7e2986ad8025 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b7499ac7-098d-48b5-adc7-383a36a887f8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:25 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b7499ac7-098d-48b5-adc7-383a36a887f8 Jul 07 22:10:25 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:25 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-269cc56e-bd70-43c0-abbe-434b5175933f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.821s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:25 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-269cc56e-bd70-43c0-abbe-434b5175933f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:10:25 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-269cc56e-bd70-43c0-abbe-434b5175933f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Deleted volume successfully. Jul 07 22:10:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-269cc56e-bd70-43c0-abbe-434b5175933f tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-8e795ed7-456e-4dcd-9498-850e1a1f79f7-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:10:25 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5e944c4a-0692-474e-9b4d-7e2986ad8025 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b7499ac7-098d-48b5-adc7-383a36a887f8" returned: 0 in 0.840s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5e944c4a-0692-474e-9b4d-7e2986ad8025 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b7499ac7-098d-48b5-adc7-383a36a887f8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:25 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b7499ac7-098d-48b5-adc7-383a36a887f8 Jul 07 22:10:25 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:26 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5e944c4a-0692-474e-9b4d-7e2986ad8025 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b7499ac7-098d-48b5-adc7-383a36a887f8" returned: 0 in 0.707s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:26 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5e944c4a-0692-474e-9b4d-7e2986ad8025 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-quobyte-b7499ac7-098d-48b5-adc7-383a36a887f8" released by "delete_volume" :: held 1.609s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:10:26 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-5e944c4a-0692-474e-9b4d-7e2986ad8025 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Created reservations ['bc6d6b5f-2952-4703-ba60-176969d6971d', 'f21a5916-25f0-4568-930d-4d10ed8d6f33', 'd30c5636-2f99-41b2-8d47-0fcf541b31ba', '7074d9f4-f874-4067-bc4f-27afee5bcdb8'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:10:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5e944c4a-0692-474e-9b4d-7e2986ad8025 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5e944c4a-0692-474e-9b4d-7e2986ad8025 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5e944c4a-0692-474e-9b4d-7e2986ad8025 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:10:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5e944c4a-0692-474e-9b4d-7e2986ad8025 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:10:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5e944c4a-0692-474e-9b4d-7e2986ad8025 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5e944c4a-0692-474e-9b4d-7e2986ad8025 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:26 devstack sudo[102831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:10:26 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9280514f-d5c8-4b82-830b-edd8f0b66312 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "cinder-bc973b3f-0636-409d-8ad0-00aeaf0ef28b-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:10:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9280514f-d5c8-4b82-830b-edd8f0b66312 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-bc973b3f-0636-409d-8ad0-00aeaf0ef28b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:10:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9280514f-d5c8-4b82-830b-edd8f0b66312 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "cinder-quobyte-bc973b3f-0636-409d-8ad0-00aeaf0ef28b" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:10:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9280514f-d5c8-4b82-830b-edd8f0b66312 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-quobyte-bc973b3f-0636-409d-8ad0-00aeaf0ef28b" acquired by "delete_volume" :: waited 0.014s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:10:27 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf33e07-35f7-4eed-a239-1c3abebffdfc]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:10:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9280514f-d5c8-4b82-830b-edd8f0b66312 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bc973b3f-0636-409d-8ad0-00aeaf0ef28b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:27 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bc973b3f-0636-409d-8ad0-00aeaf0ef28b Jul 07 22:10:27 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:27 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5e944c4a-0692-474e-9b4d-7e2986ad8025 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.772s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:27 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-5e944c4a-0692-474e-9b4d-7e2986ad8025 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:10:27 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-5e944c4a-0692-474e-9b4d-7e2986ad8025 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Deleted volume successfully. Jul 07 22:10:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5e944c4a-0692-474e-9b4d-7e2986ad8025 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-b7499ac7-098d-48b5-adc7-383a36a887f8-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:10:28 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9280514f-d5c8-4b82-830b-edd8f0b66312 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bc973b3f-0636-409d-8ad0-00aeaf0ef28b" returned: 0 in 0.896s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9280514f-d5c8-4b82-830b-edd8f0b66312 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bc973b3f-0636-409d-8ad0-00aeaf0ef28b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:28 devstack sudo[102840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bc973b3f-0636-409d-8ad0-00aeaf0ef28b Jul 07 22:10:28 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:28 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9280514f-d5c8-4b82-830b-edd8f0b66312 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bc973b3f-0636-409d-8ad0-00aeaf0ef28b" returned: 0 in 0.699s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9280514f-d5c8-4b82-830b-edd8f0b66312 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-quobyte-bc973b3f-0636-409d-8ad0-00aeaf0ef28b" released by "delete_volume" :: held 1.647s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:10:28 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-9280514f-d5c8-4b82-830b-edd8f0b66312 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Created reservations ['d0ae8c2f-777b-4228-903a-2ba11c2ed78c', '8569f7f4-5459-4aab-83bc-e5b00f7d0ac4', 'ffe78127-7e19-4334-9a5f-ce5e516a66a6', '88dee9c4-ebe5-4ebf-8dba-2a14b9d95a81'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:10:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9280514f-d5c8-4b82-830b-edd8f0b66312 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9280514f-d5c8-4b82-830b-edd8f0b66312 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:29 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9280514f-d5c8-4b82-830b-edd8f0b66312 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:10:29 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9280514f-d5c8-4b82-830b-edd8f0b66312 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:10:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9280514f-d5c8-4b82-830b-edd8f0b66312 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9280514f-d5c8-4b82-830b-edd8f0b66312 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:29 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:10:29 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:29 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9280514f-d5c8-4b82-830b-edd8f0b66312 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.736s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:29 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-9280514f-d5c8-4b82-830b-edd8f0b66312 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:10:29 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-9280514f-d5c8-4b82-830b-edd8f0b66312 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Deleted volume successfully. Jul 07 22:10:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9280514f-d5c8-4b82-830b-edd8f0b66312 tempest-CreateVolumesFromSourceVolumeTest-364630954 None] Lock "cinder-bc973b3f-0636-409d-8ad0-00aeaf0ef28b-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:10:32 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:10:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Flow 'volume_create_manager' (0ba41897-e1fa-4af5-a03a-5c495ded22ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:10:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b935bd-4f04-4b5b-becd-6f32be9c81b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b935bd-4f04-4b5b-becd-6f32be9c81b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871a45bf-0d57-43b0-a157-47dbb4c13b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5184343ed9be462f9354c86590e15faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:10:33Z,use_quota=True,user_id='4cf29325b91b4ce996d962e9fdf2ff61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077d68ca-554d-4658-bed9-5360c07c272d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077d68ca-554d-4658-bed9-5360c07c272d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baaaf6f5-fcf0-4380-95c9-c63ea006395d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baaaf6f5-fcf0-4380-95c9-c63ea006395d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '871a45bf-0d57-43b0-a157-47dbb4c13b2d', 'volume_name': 'volume-871a45bf-0d57-43b0-a157-47dbb4c13b2d', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cbba8b1-ddff-42cb-8014-68cda977c1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cbba8b1-ddff-42cb-8014-68cda977c1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b27d9c-0a62-49a3-b3e4-be7046f5de53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:32 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Volume 871a45bf-0d57-43b0-a157-47dbb4c13b2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-871a45bf-0d57-43b0-a157-47dbb4c13b2d', 'volume_size': 1} Jul 07 22:10:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871a45bf-0d57-43b0-a157-47dbb4c13b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5184343ed9be462f9354c86590e15faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:10:33Z,use_quota=True,user_id='4cf29325b91b4ce996d962e9fdf2ff61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:10:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Creating volume 871a45bf-0d57-43b0-a157-47dbb4c13b2d {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:10:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:10:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:10:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:10:32 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:10:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-871a45bf-0d57-43b0-a157-47dbb4c13b2d 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:32 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-871a45bf-0d57-43b0-a157-47dbb4c13b2d 1073741824 Jul 07 22:10:32 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:33 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-871a45bf-0d57-43b0-a157-47dbb4c13b2d 1073741824" returned: 0 in 0.894s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-871a45bf-0d57-43b0-a157-47dbb4c13b2d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:33 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-871a45bf-0d57-43b0-a157-47dbb4c13b2d Jul 07 22:10:33 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:34 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-871a45bf-0d57-43b0-a157-47dbb4c13b2d" returned: 0 in 0.703s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:10:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b27d9c-0a62-49a3-b3e4-be7046f5de53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-871a45bf-0d57-43b0-a157-47dbb4c13b2d', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da64d98-0f19-4e3f-bf2f-a0d6b4b23e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:34 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Volume volume-871a45bf-0d57-43b0-a157-47dbb4c13b2d (871a45bf-0d57-43b0-a157-47dbb4c13b2d): created successfully Jul 07 22:10:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da64d98-0f19-4e3f-bf2f-a0d6b4b23e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Flow 'volume_create_manager' (0ba41897-e1fa-4af5-a03a-5c495ded22ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:10:34 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-179a4399-9034-4312-9f2f-15899bd81d54 tempest-CinderUnicodeTest-24649449 None] Created volume successfully. Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=93,cinder:INSERT=32,cinder:UPDATE=134,cinder:DELETE=17 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:UPDATE=146,cinder:SELECT=84,cinder:INSERT=32,cinder:DELETE=8 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Flow 'volume_create_manager' (7f1a4a39-c2c9-47fb-ba1d-56a7de535e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a4317b-9ef2-4c98-8786-9452bae53502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:35 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:10:35 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a4317b-9ef2-4c98-8786-9452bae53502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:10:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1507758117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941db089-416e-4d65-a92b-d9a18f485609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5184343ed9be462f9354c86590e15faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:10:35Z,use_quota=True,user_id='4cf29325b91b4ce996d962e9fdf2ff61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f60100-d24b-4696-83cf-6dbcba9e1435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f60100-d24b-4696-83cf-6dbcba9e1435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a593294b-c5af-4b83-96d9-da6d05ac7c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a593294b-c5af-4b83-96d9-da6d05ac7c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '941db089-416e-4d65-a92b-d9a18f485609', 'volume_name': 'volume-941db089-416e-4d65-a92b-d9a18f485609', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5fc35f-e7d5-4e5e-b176-4638313fc9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5fc35f-e7d5-4e5e-b176-4638313fc9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2dac933-233c-427b-a9d0-8fc6cd7bd403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:35 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Volume 941db089-416e-4d65-a92b-d9a18f485609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-941db089-416e-4d65-a92b-d9a18f485609', 'volume_size': 1} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:10:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1507758117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941db089-416e-4d65-a92b-d9a18f485609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5184343ed9be462f9354c86590e15faf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:10:35Z,use_quota=True,user_id='4cf29325b91b4ce996d962e9fdf2ff61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Creating volume 941db089-416e-4d65-a92b-d9a18f485609 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:10:35 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:10:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:35 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609 1073741824 Jul 07 22:10:35 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:36 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.879s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:10:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:10:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 28 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 22:10:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 22:10:36 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609 1073741824" returned: 0 in 1.048s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:36 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609 Jul 07 22:10:36 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:37 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609" returned: 0 in 0.730s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:10:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2dac933-233c-427b-a9d0-8fc6cd7bd403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-941db089-416e-4d65-a92b-d9a18f485609', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15dc1955-70de-40c6-a412-65484bbc7bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:37 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Volume volume-941db089-416e-4d65-a92b-d9a18f485609 (941db089-416e-4d65-a92b-d9a18f485609): created successfully Jul 07 22:10:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15dc1955-70de-40c6-a412-65484bbc7bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Flow 'volume_create_manager' (7f1a4a39-c2c9-47fb-ba1d-56a7de535e3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:10:37 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-e371e2a2-1994-4e03-bd0d-7dba6c3b33eb tempest-CinderUnicodeTest-24649449 None] Created volume successfully. Jul 07 22:10:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8485536e-fc26-4fdb-a7d2-7dad55167ce8 tempest-CinderUnicodeTest-24649449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8485536e-fc26-4fdb-a7d2-7dad55167ce8 tempest-CinderUnicodeTest-24649449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:39 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-8485536e-fc26-4fdb-a7d2-7dad55167ce8 tempest-CinderUnicodeTest-24649449 None] Creating offline snapshot 00e1ec69-c889-4576-9d5e-94c065e71de6 of volume 941db089-416e-4d65-a92b-d9a18f485609 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:10:39 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[71355ad9-1173-4b86-a881-f7884779dc9c]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:10:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8485536e-fc26-4fdb-a7d2-7dad55167ce8 tempest-CinderUnicodeTest-24649449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:39 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609 Jul 07 22:10:39 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:39 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8485536e-fc26-4fdb-a7d2-7dad55167ce8 tempest-CinderUnicodeTest-24649449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609" returned: 0 in 0.860s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8485536e-fc26-4fdb-a7d2-7dad55167ce8 tempest-CinderUnicodeTest-24649449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.00e1ec69-c889-4576-9d5e-94c065e71de6 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:39 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.00e1ec69-c889-4576-9d5e-94c065e71de6 1G Jul 07 22:10:39 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:40 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8485536e-fc26-4fdb-a7d2-7dad55167ce8 tempest-CinderUnicodeTest-24649449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.00e1ec69-c889-4576-9d5e-94c065e71de6 1G" returned: 0 in 0.817s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8485536e-fc26-4fdb-a7d2-7dad55167ce8 tempest-CinderUnicodeTest-24649449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-941db089-416e-4d65-a92b-d9a18f485609 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.00e1ec69-c889-4576-9d5e-94c065e71de6 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:40 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-941db089-416e-4d65-a92b-d9a18f485609 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.00e1ec69-c889-4576-9d5e-94c065e71de6 Jul 07 22:10:40 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:41 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8485536e-fc26-4fdb-a7d2-7dad55167ce8 tempest-CinderUnicodeTest-24649449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-941db089-416e-4d65-a92b-d9a18f485609 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.00e1ec69-c889-4576-9d5e-94c065e71de6" returned: 0 in 0.856s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:41 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-8485536e-fc26-4fdb-a7d2-7dad55167ce8 tempest-CinderUnicodeTest-24649449 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.00e1ec69-c889-4576-9d5e-94c065e71de6 is being set with open permissions: ugo+rw Jul 07 22:10:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8485536e-fc26-4fdb-a7d2-7dad55167ce8 tempest-CinderUnicodeTest-24649449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.00e1ec69-c889-4576-9d5e-94c065e71de6 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:41 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.00e1ec69-c889-4576-9d5e-94c065e71de6 Jul 07 22:10:41 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:42 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8485536e-fc26-4fdb-a7d2-7dad55167ce8 tempest-CinderUnicodeTest-24649449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.00e1ec69-c889-4576-9d5e-94c065e71de6" returned: 0 in 0.717s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8485536e-fc26-4fdb-a7d2-7dad55167ce8 tempest-CinderUnicodeTest-24649449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:42 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.info Jul 07 22:10:42 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:43 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8485536e-fc26-4fdb-a7d2-7dad55167ce8 tempest-CinderUnicodeTest-24649449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.info" returned: 0 in 0.709s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:43 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-8485536e-fc26-4fdb-a7d2-7dad55167ce8 tempest-CinderUnicodeTest-24649449 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.info is being set with open permissions: ugo+rw Jul 07 22:10:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8485536e-fc26-4fdb-a7d2-7dad55167ce8 tempest-CinderUnicodeTest-24649449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:43 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.info Jul 07 22:10:43 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:43 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8485536e-fc26-4fdb-a7d2-7dad55167ce8 tempest-CinderUnicodeTest-24649449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.info" returned: 0 in 0.705s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8485536e-fc26-4fdb-a7d2-7dad55167ce8 tempest-CinderUnicodeTest-24649449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.767s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:43 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-8485536e-fc26-4fdb-a7d2-7dad55167ce8 tempest-CinderUnicodeTest-24649449 None] Create snapshot completed successfully Jul 07 22:10:44 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fdf9da22-8065-44ef-98dd-5e8179176624 tempest-CinderUnicodeTest-24649449 None] Acquiring lock "cinder-00e1ec69-c889-4576-9d5e-94c065e71de6-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:10:44 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fdf9da22-8065-44ef-98dd-5e8179176624 tempest-CinderUnicodeTest-24649449 None] Lock "cinder-00e1ec69-c889-4576-9d5e-94c065e71de6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:10:44 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fdf9da22-8065-44ef-98dd-5e8179176624 tempest-CinderUnicodeTest-24649449 None] Acquiring lock "cinder-quobyte-941db089-416e-4d65-a92b-d9a18f485609" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:10:44 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fdf9da22-8065-44ef-98dd-5e8179176624 tempest-CinderUnicodeTest-24649449 None] Lock "cinder-quobyte-941db089-416e-4d65-a92b-d9a18f485609" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:10:44 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fdf9da22-8065-44ef-98dd-5e8179176624 tempest-CinderUnicodeTest-24649449 None] Acquiring lock "cinder-quobyte-00e1ec69-c889-4576-9d5e-94c065e71de6" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:10:44 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fdf9da22-8065-44ef-98dd-5e8179176624 tempest-CinderUnicodeTest-24649449 None] Lock "cinder-quobyte-00e1ec69-c889-4576-9d5e-94c065e71de6" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:10:44 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-fdf9da22-8065-44ef-98dd-5e8179176624 tempest-CinderUnicodeTest-24649449 None] Deleting offline snapshot 00e1ec69-c889-4576-9d5e-94c065e71de6 of volume 941db089-416e-4d65-a92b-d9a18f485609 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:10:44 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-fdf9da22-8065-44ef-98dd-5e8179176624 tempest-CinderUnicodeTest-24649449 None] snapshot_file for this snap is: volume-941db089-416e-4d65-a92b-d9a18f485609.00e1ec69-c889-4576-9d5e-94c065e71de6 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:10:44 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9746c75-a15a-47a9-b0c0-0c6a604c8700]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:10:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fdf9da22-8065-44ef-98dd-5e8179176624 tempest-CinderUnicodeTest-24649449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.00e1ec69-c889-4576-9d5e-94c065e71de6 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:44 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.00e1ec69-c889-4576-9d5e-94c065e71de6 Jul 07 22:10:44 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:45 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fdf9da22-8065-44ef-98dd-5e8179176624 tempest-CinderUnicodeTest-24649449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.00e1ec69-c889-4576-9d5e-94c065e71de6" returned: 0 in 0.843s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-fdf9da22-8065-44ef-98dd-5e8179176624 tempest-CinderUnicodeTest-24649449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-941db089-416e-4d65-a92b-d9a18f485609(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:10:45 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d207f9cf-5cf9-4495-8585-a78ce0721ffc]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:10:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fdf9da22-8065-44ef-98dd-5e8179176624 tempest-CinderUnicodeTest-24649449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:45 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609 Jul 07 22:10:45 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:46 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fdf9da22-8065-44ef-98dd-5e8179176624 tempest-CinderUnicodeTest-24649449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609" returned: 0 in 0.862s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fdf9da22-8065-44ef-98dd-5e8179176624 tempest-CinderUnicodeTest-24649449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.00e1ec69-c889-4576-9d5e-94c065e71de6 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:46 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.00e1ec69-c889-4576-9d5e-94c065e71de6 Jul 07 22:10:46 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:47 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fdf9da22-8065-44ef-98dd-5e8179176624 tempest-CinderUnicodeTest-24649449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.00e1ec69-c889-4576-9d5e-94c065e71de6" returned: 0 in 0.803s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fdf9da22-8065-44ef-98dd-5e8179176624 tempest-CinderUnicodeTest-24649449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.00e1ec69-c889-4576-9d5e-94c065e71de6 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:47 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.00e1ec69-c889-4576-9d5e-94c065e71de6 Jul 07 22:10:47 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:47 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fdf9da22-8065-44ef-98dd-5e8179176624 tempest-CinderUnicodeTest-24649449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609.00e1ec69-c889-4576-9d5e-94c065e71de6" returned: 0 in 0.724s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:47 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fdf9da22-8065-44ef-98dd-5e8179176624 tempest-CinderUnicodeTest-24649449 None] Lock "cinder-quobyte-00e1ec69-c889-4576-9d5e-94c065e71de6" released by "_delete_snapshot" :: held 3.372s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:10:47 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fdf9da22-8065-44ef-98dd-5e8179176624 tempest-CinderUnicodeTest-24649449 None] Lock "cinder-quobyte-941db089-416e-4d65-a92b-d9a18f485609" released by "delete_snapshot" :: held 3.394s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:10:47 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-fdf9da22-8065-44ef-98dd-5e8179176624 tempest-CinderUnicodeTest-24649449 None] Created reservations ['4faaa69e-fec1-474e-a564-e61ccc631cf0', '8424dbe4-456f-4af8-b69e-5dd131a83e0e', 'c1950b52-ab96-4a5b-958f-b4eeefc2d918', '62552ebc-5f2d-4faa-b4d8-7221bfa4dfd1'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:10:47 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-fdf9da22-8065-44ef-98dd-5e8179176624 tempest-CinderUnicodeTest-24649449 None] Delete snapshot completed successfully. Jul 07 22:10:47 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fdf9da22-8065-44ef-98dd-5e8179176624 tempest-CinderUnicodeTest-24649449 None] Lock "cinder-00e1ec69-c889-4576-9d5e-94c065e71de6-delete_snapshot" released by "delete_snapshot" :: held 3.546s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:10:48 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-80b98e04-2583-49ea-8f22-8ded6af9f3ef tempest-CinderUnicodeTest-24649449 None] Acquiring lock "cinder-941db089-416e-4d65-a92b-d9a18f485609-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:10:48 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-80b98e04-2583-49ea-8f22-8ded6af9f3ef tempest-CinderUnicodeTest-24649449 None] Lock "cinder-941db089-416e-4d65-a92b-d9a18f485609-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:10:48 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-80b98e04-2583-49ea-8f22-8ded6af9f3ef tempest-CinderUnicodeTest-24649449 None] Acquiring lock "cinder-quobyte-941db089-416e-4d65-a92b-d9a18f485609" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:10:48 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-80b98e04-2583-49ea-8f22-8ded6af9f3ef tempest-CinderUnicodeTest-24649449 None] Lock "cinder-quobyte-941db089-416e-4d65-a92b-d9a18f485609" acquired by "delete_volume" :: waited 0.032s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:10:48 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2388621-80c0-4320-858c-cca0540d9ad5]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:10:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-80b98e04-2583-49ea-8f22-8ded6af9f3ef tempest-CinderUnicodeTest-24649449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:49 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609 Jul 07 22:10:49 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:49 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-80b98e04-2583-49ea-8f22-8ded6af9f3ef tempest-CinderUnicodeTest-24649449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609" returned: 0 in 0.888s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-80b98e04-2583-49ea-8f22-8ded6af9f3ef tempest-CinderUnicodeTest-24649449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:49 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609 Jul 07 22:10:49 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:50 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-80b98e04-2583-49ea-8f22-8ded6af9f3ef tempest-CinderUnicodeTest-24649449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-941db089-416e-4d65-a92b-d9a18f485609" returned: 0 in 0.753s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:50 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-80b98e04-2583-49ea-8f22-8ded6af9f3ef tempest-CinderUnicodeTest-24649449 None] Lock "cinder-quobyte-941db089-416e-4d65-a92b-d9a18f485609" released by "delete_volume" :: held 1.730s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:10:50 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-80b98e04-2583-49ea-8f22-8ded6af9f3ef tempest-CinderUnicodeTest-24649449 None] Created reservations ['378dfa2c-f37a-4d02-93a0-45f6072a35cd', '05eec0ad-80d9-4da2-96c7-fdb2a49191ce', '1a5787f4-b327-4f8c-90e8-6d4a2648b17b', 'a04fff67-efe5-466d-9702-ae9ba26594a7'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:10:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-80b98e04-2583-49ea-8f22-8ded6af9f3ef tempest-CinderUnicodeTest-24649449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-80b98e04-2583-49ea-8f22-8ded6af9f3ef tempest-CinderUnicodeTest-24649449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-80b98e04-2583-49ea-8f22-8ded6af9f3ef tempest-CinderUnicodeTest-24649449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:10:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-80b98e04-2583-49ea-8f22-8ded6af9f3ef tempest-CinderUnicodeTest-24649449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:10:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-80b98e04-2583-49ea-8f22-8ded6af9f3ef tempest-CinderUnicodeTest-24649449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-80b98e04-2583-49ea-8f22-8ded6af9f3ef tempest-CinderUnicodeTest-24649449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:50 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:10:50 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7acc14a6-94bd-4291-b427-fabdc8da7f21 tempest-CinderUnicodeTest-24649449 None] Acquiring lock "cinder-871a45bf-0d57-43b0-a157-47dbb4c13b2d-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:10:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7acc14a6-94bd-4291-b427-fabdc8da7f21 tempest-CinderUnicodeTest-24649449 None] Lock "cinder-871a45bf-0d57-43b0-a157-47dbb4c13b2d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:10:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7acc14a6-94bd-4291-b427-fabdc8da7f21 tempest-CinderUnicodeTest-24649449 None] Acquiring lock "cinder-quobyte-871a45bf-0d57-43b0-a157-47dbb4c13b2d" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:10:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7acc14a6-94bd-4291-b427-fabdc8da7f21 tempest-CinderUnicodeTest-24649449 None] Lock "cinder-quobyte-871a45bf-0d57-43b0-a157-47dbb4c13b2d" acquired by "delete_volume" :: waited 0.027s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:10:51 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[33be6bdd-c65f-42fb-8818-8bfa94e3be42]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:10:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7acc14a6-94bd-4291-b427-fabdc8da7f21 tempest-CinderUnicodeTest-24649449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-871a45bf-0d57-43b0-a157-47dbb4c13b2d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:51 devstack sudo[102966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-871a45bf-0d57-43b0-a157-47dbb4c13b2d Jul 07 22:10:51 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:51 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-80b98e04-2583-49ea-8f22-8ded6af9f3ef tempest-CinderUnicodeTest-24649449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.746s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:51 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-80b98e04-2583-49ea-8f22-8ded6af9f3ef tempest-CinderUnicodeTest-24649449 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:10:51 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-80b98e04-2583-49ea-8f22-8ded6af9f3ef tempest-CinderUnicodeTest-24649449 None] Deleted volume successfully. Jul 07 22:10:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-80b98e04-2583-49ea-8f22-8ded6af9f3ef tempest-CinderUnicodeTest-24649449 None] Lock "cinder-941db089-416e-4d65-a92b-d9a18f485609-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:10:52 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7acc14a6-94bd-4291-b427-fabdc8da7f21 tempest-CinderUnicodeTest-24649449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-871a45bf-0d57-43b0-a157-47dbb4c13b2d" returned: 0 in 0.880s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7acc14a6-94bd-4291-b427-fabdc8da7f21 tempest-CinderUnicodeTest-24649449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-871a45bf-0d57-43b0-a157-47dbb4c13b2d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:52 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-871a45bf-0d57-43b0-a157-47dbb4c13b2d Jul 07 22:10:52 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:52 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7acc14a6-94bd-4291-b427-fabdc8da7f21 tempest-CinderUnicodeTest-24649449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-871a45bf-0d57-43b0-a157-47dbb4c13b2d" returned: 0 in 0.663s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7acc14a6-94bd-4291-b427-fabdc8da7f21 tempest-CinderUnicodeTest-24649449 None] Lock "cinder-quobyte-871a45bf-0d57-43b0-a157-47dbb4c13b2d" released by "delete_volume" :: held 1.608s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:10:52 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-7acc14a6-94bd-4291-b427-fabdc8da7f21 tempest-CinderUnicodeTest-24649449 None] Created reservations ['a0c2a760-f372-4f22-abb6-b7295cc3982d', '28f45e2a-aa56-4ea8-a75e-e8d6d6926bc0', 'da70bff0-1b82-440b-bdd3-c5efa93e6d69', 'c1c0da28-2020-4301-b6c8-3744b81157af'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:10:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7acc14a6-94bd-4291-b427-fabdc8da7f21 tempest-CinderUnicodeTest-24649449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7acc14a6-94bd-4291-b427-fabdc8da7f21 tempest-CinderUnicodeTest-24649449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7acc14a6-94bd-4291-b427-fabdc8da7f21 tempest-CinderUnicodeTest-24649449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:10:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7acc14a6-94bd-4291-b427-fabdc8da7f21 tempest-CinderUnicodeTest-24649449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:10:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7acc14a6-94bd-4291-b427-fabdc8da7f21 tempest-CinderUnicodeTest-24649449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7acc14a6-94bd-4291-b427-fabdc8da7f21 tempest-CinderUnicodeTest-24649449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:52 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:10:52 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:53 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7acc14a6-94bd-4291-b427-fabdc8da7f21 tempest-CinderUnicodeTest-24649449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.711s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:53 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-7acc14a6-94bd-4291-b427-fabdc8da7f21 tempest-CinderUnicodeTest-24649449 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:10:53 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-7acc14a6-94bd-4291-b427-fabdc8da7f21 tempest-CinderUnicodeTest-24649449 None] Deleted volume successfully. Jul 07 22:10:53 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7acc14a6-94bd-4291-b427-fabdc8da7f21 tempest-CinderUnicodeTest-24649449 None] Lock "cinder-871a45bf-0d57-43b0-a157-47dbb4c13b2d-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:10:58 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:10:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Flow 'volume_create_manager' (f6084135-53de-48ef-add6-dd5e726ad469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:10:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5ff346-ca01-4ad6-88ec-53896013aa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5ff346-ca01-4ad6-88ec-53896013aa2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1021289485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec7812a9-7c84-4834-b5b8-af8a29b8bdcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8305594c17054340b429133569f79c0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:10:58Z,use_quota=True,user_id='e2e20fca56084b0f9dc92db27e40b71c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c498a8f3-63af-44e6-a519-d90a1c9d8a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c498a8f3-63af-44e6-a519-d90a1c9d8a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7099faad-f7a0-43b1-b019-f78896b18bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7099faad-f7a0-43b1-b019-f78896b18bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec7812a9-7c84-4834-b5b8-af8a29b8bdcd', 'volume_name': 'volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b008bb3-c522-40a2-b58c-aed25dcf2ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b008bb3-c522-40a2-b58c-aed25dcf2ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:10:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cbc7fe3-6fdc-4ed7-bd61-1a963d6c745f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:10:58 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Volume ec7812a9-7c84-4834-b5b8-af8a29b8bdcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd', 'volume_size': 1} Jul 07 22:10:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1021289485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec7812a9-7c84-4834-b5b8-af8a29b8bdcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8305594c17054340b429133569f79c0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:10:58Z,use_quota=True,user_id='e2e20fca56084b0f9dc92db27e40b71c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:10:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Creating volume ec7812a9-7c84-4834-b5b8-af8a29b8bdcd {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:10:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:10:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:10:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:10:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:10:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:10:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:10:58 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:10:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:58 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd 1073741824 Jul 07 22:10:58 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:59 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd 1073741824" returned: 0 in 1.000s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:10:59 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd Jul 07 22:10:59 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:10:59 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Jul 07 22:10:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd" returned: 0 in 0.819s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:10:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:10:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:11:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cbc7fe3-6fdc-4ed7-bd61-1a963d6c745f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:11:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58375851-59fd-4a58-8195-4ebcd7e2d2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:11:00 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Volume volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd (ec7812a9-7c84-4834-b5b8-af8a29b8bdcd): created successfully Jul 07 22:11:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58375851-59fd-4a58-8195-4ebcd7e2d2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:11:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Flow 'volume_create_manager' (f6084135-53de-48ef-add6-dd5e726ad469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:11:00 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-dac7b730-9a4c-447c-81b1-cdac23727962 tempest-TestStampPattern-927079618 None] Created volume successfully. Jul 07 22:11:10 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=31,cinder:UPDATE=21,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:11:10 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:UPDATE=36,cinder:INSERT=9,cinder:SELECT=14,cinder:DELETE=3 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:11:19 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:11:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Flow 'volume_create_manager' (589e168c-bc42-4494-ab3b-84c186abbf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:11:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a01f4d70-9d97-4228-8277-6f61aae74e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:11:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a01f4d70-9d97-4228-8277-6f61aae74e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-228085681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8586ab-09c4-49b2-a537-0b0a4b7f2d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df2b498faf154a8caa05e5e1a209805b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:11:20Z,use_quota=True,user_id='21a6a4005b554600a1b502fff83325d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:11:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48980d07-7acf-4548-ad02-54d54f0d9d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:11:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48980d07-7acf-4548-ad02-54d54f0d9d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:11:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584c28bf-28b4-40e0-b80d-ae2def575ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:11:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584c28bf-28b4-40e0-b80d-ae2def575ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d8586ab-09c4-49b2-a537-0b0a4b7f2d24', 'volume_name': 'volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:11:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25934141-09d3-4130-ba97-62d95a40aa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:11:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25934141-09d3-4130-ba97-62d95a40aa79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:11:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48142e36-e283-49c6-9ae2-0a682c3b2da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:11:19 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Volume 2d8586ab-09c4-49b2-a537-0b0a4b7f2d24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24', 'volume_size': 1} Jul 07 22:11:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:11:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:11:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-228085681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8586ab-09c4-49b2-a537-0b0a4b7f2d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df2b498faf154a8caa05e5e1a209805b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:11:20Z,use_quota=True,user_id='21a6a4005b554600a1b502fff83325d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:11:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Creating volume 2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:11:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:11:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:11:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:11:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:11:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:11:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:11:19 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:11:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:19 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 1073741824 Jul 07 22:11:19 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:20 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 1073741824" returned: 0 in 0.807s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:20 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 Jul 07 22:11:20 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:21 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24" returned: 0 in 0.653s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:11:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:11:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48142e36-e283-49c6-9ae2-0a682c3b2da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:11:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (285b28e4-c8c6-43af-b027-fcaeef938e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:11:21 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Volume volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 (2d8586ab-09c4-49b2-a537-0b0a4b7f2d24): created successfully Jul 07 22:11:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (285b28e4-c8c6-43af-b027-fcaeef938e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:11:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Flow 'volume_create_manager' (589e168c-bc42-4494-ab3b-84c186abbf6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:11:21 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-11b28577-2c17-4104-8265-8a47ad2715a7 tempest-SnapshotDependencyTests-186729099 None] Created volume successfully. Jul 07 22:11:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-50d16746-07c6-47f1-8d20-041ed58c58f1 tempest-SnapshotDependencyTests-186729099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:11:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-50d16746-07c6-47f1-8d20-041ed58c58f1 tempest-SnapshotDependencyTests-186729099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:11:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-50d16746-07c6-47f1-8d20-041ed58c58f1 tempest-SnapshotDependencyTests-186729099 None] Creating offline snapshot ad20f800-5b6c-4d81-8565-d757d955c1d9 of volume 2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:11:22 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a923567-71c6-48d2-96dd-f8d3fe33d897]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:11:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-50d16746-07c6-47f1-8d20-041ed58c58f1 tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:22 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 Jul 07 22:11:22 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:22 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-50d16746-07c6-47f1-8d20-041ed58c58f1 tempest-SnapshotDependencyTests-186729099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24" returned: 0 in 0.832s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-50d16746-07c6-47f1-8d20-041ed58c58f1 tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:23 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9 1G Jul 07 22:11:23 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:23 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-50d16746-07c6-47f1-8d20-041ed58c58f1 tempest-SnapshotDependencyTests-186729099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9 1G" returned: 0 in 0.871s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-50d16746-07c6-47f1-8d20-041ed58c58f1 tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:23 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9 Jul 07 22:11:23 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:24 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-50d16746-07c6-47f1-8d20-041ed58c58f1 tempest-SnapshotDependencyTests-186729099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9" returned: 0 in 0.709s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:24 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-50d16746-07c6-47f1-8d20-041ed58c58f1 tempest-SnapshotDependencyTests-186729099 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9 is being set with open permissions: ugo+rw Jul 07 22:11:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-50d16746-07c6-47f1-8d20-041ed58c58f1 tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:24 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9 Jul 07 22:11:24 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:25 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-50d16746-07c6-47f1-8d20-041ed58c58f1 tempest-SnapshotDependencyTests-186729099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9" returned: 0 in 0.709s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-50d16746-07c6-47f1-8d20-041ed58c58f1 tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:25 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.info Jul 07 22:11:25 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:25 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-50d16746-07c6-47f1-8d20-041ed58c58f1 tempest-SnapshotDependencyTests-186729099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.info" returned: 0 in 0.648s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:25 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-50d16746-07c6-47f1-8d20-041ed58c58f1 tempest-SnapshotDependencyTests-186729099 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.info is being set with open permissions: ugo+rw Jul 07 22:11:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-50d16746-07c6-47f1-8d20-041ed58c58f1 tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:25 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.info Jul 07 22:11:25 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:26 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-50d16746-07c6-47f1-8d20-041ed58c58f1 tempest-SnapshotDependencyTests-186729099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.info" returned: 0 in 0.658s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-50d16746-07c6-47f1-8d20-041ed58c58f1 tempest-SnapshotDependencyTests-186729099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.518s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:11:26 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-50d16746-07c6-47f1-8d20-041ed58c58f1 tempest-SnapshotDependencyTests-186729099 None] Create snapshot completed successfully Jul 07 22:11:27 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Flow 'volume_create_manager' (75821181-e2b7-490d-aea3-df170cbcd0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5b39a4-ca09-4d77-b6dd-7cb78d8a13c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5b39a4-ca09-4d77-b6dd-7cb78d8a13c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3377eb0-1da6-4122-9468-10733dad12e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df2b498faf154a8caa05e5e1a209805b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ad20f800-5b6c-4d81-8565-d757d955c1d9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:11:28Z,use_quota=True,user_id='21a6a4005b554600a1b502fff83325d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad3b15b-5b9a-4096-937b-3c885feeb993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad3b15b-5b9a-4096-937b-3c885feeb993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be24c8fa-8853-4bd4-9122-15a4f898537a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be24c8fa-8853-4bd4-9122-15a4f898537a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a3377eb0-1da6-4122-9468-10733dad12e2', 'volume_name': 'volume-a3377eb0-1da6-4122-9468-10733dad12e2', 'volume_size': 1, 'snapshot_id': 'ad20f800-5b6c-4d81-8565-d757d955c1d9'}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e478eb-d99a-45e9-b5b9-b45165eb3867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e478eb-d99a-45e9-b5b9-b45165eb3867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a279ef-7ebd-433b-884d-7df34dd032f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:11:28 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Volume a3377eb0-1da6-4122-9468-10733dad12e2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a3377eb0-1da6-4122-9468-10733dad12e2', 'volume_size': 1, 'snapshot_id': 'ad20f800-5b6c-4d81-8565-d757d955c1d9'} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Acquiring lock "cinder-quobyte-ad20f800-5b6c-4d81-8565-d757d955c1d9-a3377eb0-1da6-4122-9468-10733dad12e2" by "_create_volume_from_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Lock "cinder-quobyte-ad20f800-5b6c-4d81-8565-d757d955c1d9-a3377eb0-1da6-4122-9468-10733dad12e2" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Creating volume a3377eb0-1da6-4122-9468-10733dad12e2 from snapshot ad20f800-5b6c-4d81-8565-d757d955c1d9 {{(pid=87586) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Acquiring lock "cinder-quobyte-a3377eb0-1da6-4122-9468-10733dad12e2" by "_copy_volume_from_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Lock "cinder-quobyte-a3377eb0-1da6-4122-9468-10733dad12e2" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] snapshot: ad20f800-5b6c-4d81-8565-d757d955c1d9, volume: a3377eb0-1da6-4122-9468-10733dad12e2, {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f3f320-2f6c-4d44-9895-10ae9c66c11b]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:11:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:28 devstack sudo[103133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9 Jul 07 22:11:28 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:29 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9" returned: 0 in 0.838s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:29 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:11:29 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:11:29 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Creating direct copy from snapshot {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:11:29 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af75eb6-dda4-4ce4-a5da-9f6177a79055]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:11:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:29 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 Jul 07 22:11:29 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:29 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24" returned: 0 in 0.825s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:29 devstack cinder-volume[87586]: DEBUG cinder.utils [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Path /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a3377eb0-1da6-4122-9468-10733dad12e2 not found in is_blk_device check {{(pid=87586) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:11:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a3377eb0-1da6-4122-9468-10733dad12e2 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:29 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a3377eb0-1da6-4122-9468-10733dad12e2 Jul 07 22:11:29 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:34 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a3377eb0-1da6-4122-9468-10733dad12e2" returned: 0 in 4.999s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:34 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bb1547-b739-48a6-8b3b-3b3f9e392899]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:11:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:34 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 Jul 07 22:11:34 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:11:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:11:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:11:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:11:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:11:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:11:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:35 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:11:35 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:35 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24" returned: 0 in 0.906s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:35 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Image conversion details: src /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24, size 1024.00 MB, duration 5.00 sec, destination /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a3377eb0-1da6-4122-9468-10733dad12e2 {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:11:35 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Converted 1024.00 MB image at 204.78 MB/s Jul 07 22:11:35 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a3377eb0-1da6-4122-9468-10733dad12e2 is being set with open permissions: ugo+rw Jul 07 22:11:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a3377eb0-1da6-4122-9468-10733dad12e2 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:35 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a3377eb0-1da6-4122-9468-10733dad12e2 Jul 07 22:11:35 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:36 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.619s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 28 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 22:11:36 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a3377eb0-1da6-4122-9468-10733dad12e2" returned: 0 in 0.629s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Lock "cinder-quobyte-a3377eb0-1da6-4122-9468-10733dad12e2" released by "_copy_volume_from_snapshot" :: held 8.294s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Lock "cinder-quobyte-ad20f800-5b6c-4d81-8565-d757d955c1d9-a3377eb0-1da6-4122-9468-10733dad12e2" released by "_create_volume_from_snapshot" :: held 8.324s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.343s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a279ef-7ebd-433b-884d-7df34dd032f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3377eb0-1da6-4122-9468-10733dad12e2', 'volume_size': 1, 'snapshot_id': 'ad20f800-5b6c-4d81-8565-d757d955c1d9'}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62e3bc4-a90a-4bae-9a8a-8cc2385f8e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:11:36 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Volume volume-a3377eb0-1da6-4122-9468-10733dad12e2 (a3377eb0-1da6-4122-9468-10733dad12e2): created successfully Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62e3bc4-a90a-4bae-9a8a-8cc2385f8e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Flow 'volume_create_manager' (75821181-e2b7-490d-aea3-df170cbcd0ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:11:36 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-947b3d81-c072-44d1-9e67-9a03b0783ca6 tempest-SnapshotDependencyTests-186729099 None] Created volume successfully. Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-edf689a4-4c63-45ca-9d5c-3f9c27c485bd tempest-SnapshotDependencyTests-186729099 None] Acquiring lock "cinder-ad20f800-5b6c-4d81-8565-d757d955c1d9-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-edf689a4-4c63-45ca-9d5c-3f9c27c485bd tempest-SnapshotDependencyTests-186729099 None] Lock "cinder-ad20f800-5b6c-4d81-8565-d757d955c1d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-edf689a4-4c63-45ca-9d5c-3f9c27c485bd tempest-SnapshotDependencyTests-186729099 None] Acquiring lock "cinder-quobyte-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-edf689a4-4c63-45ca-9d5c-3f9c27c485bd tempest-SnapshotDependencyTests-186729099 None] Lock "cinder-quobyte-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-edf689a4-4c63-45ca-9d5c-3f9c27c485bd tempest-SnapshotDependencyTests-186729099 None] Acquiring lock "cinder-quobyte-ad20f800-5b6c-4d81-8565-d757d955c1d9" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-edf689a4-4c63-45ca-9d5c-3f9c27c485bd tempest-SnapshotDependencyTests-186729099 None] Lock "cinder-quobyte-ad20f800-5b6c-4d81-8565-d757d955c1d9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-edf689a4-4c63-45ca-9d5c-3f9c27c485bd tempest-SnapshotDependencyTests-186729099 None] Deleting offline snapshot ad20f800-5b6c-4d81-8565-d757d955c1d9 of volume 2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-edf689a4-4c63-45ca-9d5c-3f9c27c485bd tempest-SnapshotDependencyTests-186729099 None] snapshot_file for this snap is: volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1d0481-c994-4169-9f45-832a1cbf997e]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:11:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-edf689a4-4c63-45ca-9d5c-3f9c27c485bd tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:37 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9 Jul 07 22:11:37 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:37 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-edf689a4-4c63-45ca-9d5c-3f9c27c485bd tempest-SnapshotDependencyTests-186729099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9" returned: 0 in 0.750s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-edf689a4-4c63-45ca-9d5c-3f9c27c485bd tempest-SnapshotDependencyTests-186729099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:11:37 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[865d5ba5-bdd4-4842-9b50-1ce27b13c6d4]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:11:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-edf689a4-4c63-45ca-9d5c-3f9c27c485bd tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:37 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 Jul 07 22:11:37 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:38 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-edf689a4-4c63-45ca-9d5c-3f9c27c485bd tempest-SnapshotDependencyTests-186729099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24" returned: 0 in 0.770s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-edf689a4-4c63-45ca-9d5c-3f9c27c485bd tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:38 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9 Jul 07 22:11:38 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:39 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-edf689a4-4c63-45ca-9d5c-3f9c27c485bd tempest-SnapshotDependencyTests-186729099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9" returned: 0 in 0.702s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-edf689a4-4c63-45ca-9d5c-3f9c27c485bd tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:39 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9 Jul 07 22:11:39 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:39 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-edf689a4-4c63-45ca-9d5c-3f9c27c485bd tempest-SnapshotDependencyTests-186729099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24.ad20f800-5b6c-4d81-8565-d757d955c1d9" returned: 0 in 0.604s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-edf689a4-4c63-45ca-9d5c-3f9c27c485bd tempest-SnapshotDependencyTests-186729099 None] Lock "cinder-quobyte-ad20f800-5b6c-4d81-8565-d757d955c1d9" released by "_delete_snapshot" :: held 2.919s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:11:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-edf689a4-4c63-45ca-9d5c-3f9c27c485bd tempest-SnapshotDependencyTests-186729099 None] Lock "cinder-quobyte-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24" released by "delete_snapshot" :: held 2.943s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:11:39 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-edf689a4-4c63-45ca-9d5c-3f9c27c485bd tempest-SnapshotDependencyTests-186729099 None] Created reservations ['1f1f50ed-17f7-47bf-9418-afcf542680d2', '0f96f05b-b7b2-496a-a721-4fd3c4bf455b', '2f668f26-79d6-46aa-af9c-87c5b54eda39', '0389a980-f07e-49d7-b634-bb9e23a074cd'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:11:39 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-edf689a4-4c63-45ca-9d5c-3f9c27c485bd tempest-SnapshotDependencyTests-186729099 None] Delete snapshot completed successfully. Jul 07 22:11:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-edf689a4-4c63-45ca-9d5c-3f9c27c485bd tempest-SnapshotDependencyTests-186729099 None] Lock "cinder-ad20f800-5b6c-4d81-8565-d757d955c1d9-delete_snapshot" released by "delete_snapshot" :: held 3.079s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:11:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-2d887d50-964a-42ed-9ab4-d495ee87400d tempest-SnapshotDependencyTests-186729099 None] Acquiring lock "cinder-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:11:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-2d887d50-964a-42ed-9ab4-d495ee87400d tempest-SnapshotDependencyTests-186729099 None] Lock "cinder-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:11:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-2d887d50-964a-42ed-9ab4-d495ee87400d tempest-SnapshotDependencyTests-186729099 None] Acquiring lock "cinder-quobyte-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:11:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-2d887d50-964a-42ed-9ab4-d495ee87400d tempest-SnapshotDependencyTests-186729099 None] Lock "cinder-quobyte-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24" acquired by "delete_volume" :: waited 0.014s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:11:40 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9eacfcb-26b2-4ce0-9c2d-ff5f6ed0ae8d]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:11:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2d887d50-964a-42ed-9ab4-d495ee87400d tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:40 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 Jul 07 22:11:40 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:40 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2d887d50-964a-42ed-9ab4-d495ee87400d tempest-SnapshotDependencyTests-186729099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24" returned: 0 in 0.755s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2d887d50-964a-42ed-9ab4-d495ee87400d tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:40 devstack sudo[103207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24 Jul 07 22:11:40 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-ad05f09a-d92a-48a5-81ce-4994d402706d req-af4ba8b8-25f8-4e49-9ce1-e96f9b934c81 tempest-TestStampPattern-927079618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:11:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-ad05f09a-d92a-48a5-81ce-4994d402706d req-af4ba8b8-25f8-4e49-9ce1-e96f9b934c81 tempest-TestStampPattern-927079618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:11:41 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fad494c-c0b7-47a6-9190-6f4025b8092f]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:11:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-ad05f09a-d92a-48a5-81ce-4994d402706d req-af4ba8b8-25f8-4e49-9ce1-e96f9b934c81 tempest-TestStampPattern-927079618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:41 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd Jul 07 22:11:41 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:41 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2d887d50-964a-42ed-9ab4-d495ee87400d tempest-SnapshotDependencyTests-186729099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24" returned: 0 in 0.664s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:41 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-2d887d50-964a-42ed-9ab4-d495ee87400d tempest-SnapshotDependencyTests-186729099 None] Lock "cinder-quobyte-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24" released by "delete_volume" :: held 1.478s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:11:41 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-2d887d50-964a-42ed-9ab4-d495ee87400d tempest-SnapshotDependencyTests-186729099 None] Created reservations ['e39bb4df-9535-472b-9a87-9db9ec42b92f', '9831df7d-aa94-4fd6-b323-c22811b11244', '8b4c02a5-4171-4052-8ced-8b61688ff8af', '4ffbf80b-0c9b-4715-87a7-77cdbf8fa388'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:11:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2d887d50-964a-42ed-9ab4-d495ee87400d tempest-SnapshotDependencyTests-186729099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:11:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2d887d50-964a-42ed-9ab4-d495ee87400d tempest-SnapshotDependencyTests-186729099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:11:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2d887d50-964a-42ed-9ab4-d495ee87400d tempest-SnapshotDependencyTests-186729099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:11:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2d887d50-964a-42ed-9ab4-d495ee87400d tempest-SnapshotDependencyTests-186729099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:11:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2d887d50-964a-42ed-9ab4-d495ee87400d tempest-SnapshotDependencyTests-186729099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:11:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2d887d50-964a-42ed-9ab4-d495ee87400d tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:41 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:11:41 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:42 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-ad05f09a-d92a-48a5-81ce-4994d402706d req-af4ba8b8-25f8-4e49-9ce1-e96f9b934c81 tempest-TestStampPattern-927079618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd" returned: 0 in 0.811s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-ad05f09a-d92a-48a5-81ce-4994d402706d req-af4ba8b8-25f8-4e49-9ce1-e96f9b934c81 tempest-TestStampPattern-927079618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.831s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:11:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-ad05f09a-d92a-48a5-81ce-4994d402706d req-af4ba8b8-25f8-4e49-9ce1-e96f9b934c81 tempest-TestStampPattern-927079618 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491', 'name': 'volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c30d54d9-be08-43d5-b0af-c54652860a57', 'enforce_multipath': True} {{(pid=87586) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4930}} Jul 07 22:11:42 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-ad05f09a-d92a-48a5-81ce-4994d402706d req-af4ba8b8-25f8-4e49-9ce1-e96f9b934c81 tempest-TestStampPattern-927079618 None] attachment_update completed successfully. Jul 07 22:11:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8c8fb551-a6ee-4585-bbbd-91ba892b866a tempest-SnapshotDependencyTests-186729099 None] Acquiring lock "cinder-a3377eb0-1da6-4122-9468-10733dad12e2-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:11:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8c8fb551-a6ee-4585-bbbd-91ba892b866a tempest-SnapshotDependencyTests-186729099 None] Lock "cinder-a3377eb0-1da6-4122-9468-10733dad12e2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:11:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8c8fb551-a6ee-4585-bbbd-91ba892b866a tempest-SnapshotDependencyTests-186729099 None] Acquiring lock "cinder-quobyte-a3377eb0-1da6-4122-9468-10733dad12e2" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:11:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8c8fb551-a6ee-4585-bbbd-91ba892b866a tempest-SnapshotDependencyTests-186729099 None] Lock "cinder-quobyte-a3377eb0-1da6-4122-9468-10733dad12e2" acquired by "delete_volume" :: waited 0.025s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:11:42 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cd6133-bf01-4cf4-9a9a-1b2d049fef59]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:11:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8c8fb551-a6ee-4585-bbbd-91ba892b866a tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a3377eb0-1da6-4122-9468-10733dad12e2 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:42 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2d887d50-964a-42ed-9ab4-d495ee87400d tempest-SnapshotDependencyTests-186729099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.728s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:42 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-2d887d50-964a-42ed-9ab4-d495ee87400d tempest-SnapshotDependencyTests-186729099 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:11:42 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-2d887d50-964a-42ed-9ab4-d495ee87400d tempest-SnapshotDependencyTests-186729099 None] Deleted volume successfully. Jul 07 22:11:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-2d887d50-964a-42ed-9ab4-d495ee87400d tempest-SnapshotDependencyTests-186729099 None] Lock "cinder-2d8586ab-09c4-49b2-a537-0b0a4b7f2d24-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:11:42 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a3377eb0-1da6-4122-9468-10733dad12e2 Jul 07 22:11:42 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:43 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8c8fb551-a6ee-4585-bbbd-91ba892b866a tempest-SnapshotDependencyTests-186729099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a3377eb0-1da6-4122-9468-10733dad12e2" returned: 0 in 0.804s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8c8fb551-a6ee-4585-bbbd-91ba892b866a tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a3377eb0-1da6-4122-9468-10733dad12e2 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:43 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a3377eb0-1da6-4122-9468-10733dad12e2 Jul 07 22:11:43 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:43 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8c8fb551-a6ee-4585-bbbd-91ba892b866a tempest-SnapshotDependencyTests-186729099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a3377eb0-1da6-4122-9468-10733dad12e2" returned: 0 in 0.635s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8c8fb551-a6ee-4585-bbbd-91ba892b866a tempest-SnapshotDependencyTests-186729099 None] Lock "cinder-quobyte-a3377eb0-1da6-4122-9468-10733dad12e2" released by "delete_volume" :: held 1.484s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:11:43 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-8c8fb551-a6ee-4585-bbbd-91ba892b866a tempest-SnapshotDependencyTests-186729099 None] Created reservations ['f0de211d-75af-4e90-ac55-2d3fde4358f0', 'd98a2a84-abaf-444d-87ea-2bfc4f2ef581', '61c8b473-0b86-4d06-9e83-fbfb44451e31', 'c41ba75b-5f22-4796-8e80-fd792a8ce258'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:11:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8c8fb551-a6ee-4585-bbbd-91ba892b866a tempest-SnapshotDependencyTests-186729099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:11:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8c8fb551-a6ee-4585-bbbd-91ba892b866a tempest-SnapshotDependencyTests-186729099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:11:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8c8fb551-a6ee-4585-bbbd-91ba892b866a tempest-SnapshotDependencyTests-186729099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:11:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8c8fb551-a6ee-4585-bbbd-91ba892b866a tempest-SnapshotDependencyTests-186729099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:11:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8c8fb551-a6ee-4585-bbbd-91ba892b866a tempest-SnapshotDependencyTests-186729099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:11:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8c8fb551-a6ee-4585-bbbd-91ba892b866a tempest-SnapshotDependencyTests-186729099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:44 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:11:44 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:44 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8c8fb551-a6ee-4585-bbbd-91ba892b866a tempest-SnapshotDependencyTests-186729099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.663s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:44 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-8c8fb551-a6ee-4585-bbbd-91ba892b866a tempest-SnapshotDependencyTests-186729099 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:11:44 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-8c8fb551-a6ee-4585-bbbd-91ba892b866a tempest-SnapshotDependencyTests-186729099 None] Deleted volume successfully. Jul 07 22:11:44 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8c8fb551-a6ee-4585-bbbd-91ba892b866a tempest-SnapshotDependencyTests-186729099 None] Lock "cinder-a3377eb0-1da6-4122-9468-10733dad12e2-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:11:50 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-719d7e2a-36a4-4aa9-ac2a-ccd9b33c45dc req-f6672829-3303-4fa5-b7e4-02b23a8b94c5 tempest-TestStampPattern-927079618 None] Terminate volume connection completed successfully. Jul 07 22:11:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-719d7e2a-36a4-4aa9-ac2a-ccd9b33c45dc req-f6672829-3303-4fa5-b7e4-02b23a8b94c5 tempest-TestStampPattern-927079618 None] Deleting attachment c30d54d9-be08-43d5-b0af-c54652860a57. {{(pid=87586) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 07 22:11:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c15df668-364c-451b-b783-cbd45f29f264 tempest-TestStampPattern-927079618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:11:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c15df668-364c-451b-b783-cbd45f29f264 tempest-TestStampPattern-927079618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:11:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-c15df668-364c-451b-b783-cbd45f29f264 tempest-TestStampPattern-927079618 None] Creating offline snapshot 5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e of volume ec7812a9-7c84-4834-b5b8-af8a29b8bdcd {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:11:52 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae9e6ab-a13d-422f-918e-72b8a1103405]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:11:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c15df668-364c-451b-b783-cbd45f29f264 tempest-TestStampPattern-927079618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:53 devstack sudo[103715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd Jul 07 22:11:53 devstack sudo[103715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:53 devstack sudo[103715]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c15df668-364c-451b-b783-cbd45f29f264 tempest-TestStampPattern-927079618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd" returned: 0 in 0.846s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c15df668-364c-451b-b783-cbd45f29f264 tempest-TestStampPattern-927079618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:53 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e 1G Jul 07 22:11:53 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:54 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c15df668-364c-451b-b783-cbd45f29f264 tempest-TestStampPattern-927079618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e 1G" returned: 0 in 0.820s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c15df668-364c-451b-b783-cbd45f29f264 tempest-TestStampPattern-927079618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:54 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e Jul 07 22:11:54 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:55 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c15df668-364c-451b-b783-cbd45f29f264 tempest-TestStampPattern-927079618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e" returned: 0 in 0.666s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:55 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-c15df668-364c-451b-b783-cbd45f29f264 tempest-TestStampPattern-927079618 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e is being set with open permissions: ugo+rw Jul 07 22:11:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c15df668-364c-451b-b783-cbd45f29f264 tempest-TestStampPattern-927079618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:55 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e Jul 07 22:11:55 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:55 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c15df668-364c-451b-b783-cbd45f29f264 tempest-TestStampPattern-927079618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e" returned: 0 in 0.610s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c15df668-364c-451b-b783-cbd45f29f264 tempest-TestStampPattern-927079618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:55 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.info Jul 07 22:11:55 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:56 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c15df668-364c-451b-b783-cbd45f29f264 tempest-TestStampPattern-927079618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.info" returned: 0 in 0.686s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:56 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-c15df668-364c-451b-b783-cbd45f29f264 tempest-TestStampPattern-927079618 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.info is being set with open permissions: ugo+rw Jul 07 22:11:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c15df668-364c-451b-b783-cbd45f29f264 tempest-TestStampPattern-927079618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:11:56 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.info Jul 07 22:11:56 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:11:57 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Jul 07 22:11:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c15df668-364c-451b-b783-cbd45f29f264 tempest-TestStampPattern-927079618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.info" returned: 0 in 0.653s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:11:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c15df668-364c-451b-b783-cbd45f29f264 tempest-TestStampPattern-927079618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.377s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:11:57 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-c15df668-364c-451b-b783-cbd45f29f264 tempest-TestStampPattern-927079618 None] Create snapshot completed successfully Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=33,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:UPDATE=33,cinder:SELECT=35,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Flow 'volume_create_manager' (5a94dc16-a424-4ebb-b87d-4ccf51fcb8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69551304-e807-4a2f-b898-fde2f694227b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69551304-e807-4a2f-b898-fde2f694227b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-298257516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f2a0af-3d5b-4ec8-89f6-a57d2e118b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8305594c17054340b429133569f79c0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:12:08Z,use_quota=True,user_id='e2e20fca56084b0f9dc92db27e40b71c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0d5333-9224-4ce9-8119-062c0f4afbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0d5333-9224-4ce9-8119-062c0f4afbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2459806-0353-41a9-8451-34d425e3adf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2459806-0353-41a9-8451-34d425e3adf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '48f2a0af-3d5b-4ec8-89f6-a57d2e118b08', 'volume_name': 'volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08', 'volume_size': 1, 'snapshot_id': '5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e'}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146bbfa6-6817-410c-8d45-6c91a61d5ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146bbfa6-6817-410c-8d45-6c91a61d5ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b72a4f2-ea29-4fa4-b8ef-f640e4f77b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:12:07 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Volume 48f2a0af-3d5b-4ec8-89f6-a57d2e118b08: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08', 'volume_size': 1, 'snapshot_id': '5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e'} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Acquiring lock "cinder-quobyte-5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08" by "_create_volume_from_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Lock "cinder-quobyte-5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Creating volume 48f2a0af-3d5b-4ec8-89f6-a57d2e118b08 from snapshot 5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e {{(pid=87586) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:12:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Acquiring lock "cinder-quobyte-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08" by "_copy_volume_from_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:12:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Lock "cinder-quobyte-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:12:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] snapshot: 5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e, volume: 48f2a0af-3d5b-4ec8-89f6-a57d2e118b08, {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:12:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:12:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:12:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:12:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:12:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:12:08 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[21524465-f613-4506-9922-e3049dbe5250]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:12:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:12:08 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e Jul 07 22:12:08 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:12:08 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Jul 07 22:12:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e" returned: 0 in 0.800s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:12:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:12:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:12:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Creating direct copy from snapshot {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:12:08 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[47eeb9f6-17e3-464e-bad0-71dee45eb10e]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:12:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:12:09 devstack sudo[103784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd Jul 07 22:12:09 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:12:09 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root Jul 07 22:12:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd" returned: 0 in 0.794s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:12:09 devstack cinder-volume[87586]: DEBUG cinder.utils [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Path /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08 not found in is_blk_device check {{(pid=87586) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:12:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:12:09 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08 Jul 07 22:12:09 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:12:14 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Jul 07 22:12:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08" returned: 0 in 4.777s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:12:14 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68b8fe7-8e64-474c-a568-8a343ae4bf3b]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:12:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:12:14 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd Jul 07 22:12:14 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:12:15 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Jul 07 22:12:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd" returned: 0 in 0.998s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:12:15 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Image conversion details: src /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd, size 1024.00 MB, duration 4.78 sec, destination /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08 {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:12:15 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Converted 1024.00 MB image at 214.30 MB/s Jul 07 22:12:15 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08 is being set with open permissions: ugo+rw Jul 07 22:12:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:12:15 devstack sudo[103809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08 Jul 07 22:12:15 devstack sudo[103809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:12:16 devstack sudo[103809]: pam_unix(sudo:session): session closed for user root Jul 07 22:12:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08" returned: 0 in 0.777s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:12:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Lock "cinder-quobyte-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08" released by "_copy_volume_from_snapshot" :: held 8.251s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:12:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Lock "cinder-quobyte-5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08" released by "_create_volume_from_snapshot" :: held 8.294s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:12:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.314s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:12:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b72a4f2-ea29-4fa4-b8ef-f640e4f77b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08', 'volume_size': 1, 'snapshot_id': '5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e'}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:12:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db8a917-20a5-4533-aa83-8c5607adc59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:12:16 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Volume volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08 (48f2a0af-3d5b-4ec8-89f6-a57d2e118b08): created successfully Jul 07 22:12:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db8a917-20a5-4533-aa83-8c5607adc59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:12:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Flow 'volume_create_manager' (5a94dc16-a424-4ebb-b87d-4ccf51fcb8c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:12:16 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-3e955581-e931-4a12-995a-d2b1f1945b0e tempest-TestStampPattern-927079618 None] Created volume successfully. Jul 07 22:12:26 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:12:26 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:12:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:12:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:12:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:12:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:12:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:12:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:12:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:12:35 devstack sudo[103912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:12:35 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:12:36 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root Jul 07 22:12:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.636s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:12:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:12:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:12:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 28 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 22:12:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 22:13:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-d5d195e5-66c5-4188-8d3f-ff305e20479d req-1657bfa0-aef5-4e6d-b928-f95ed5a04a3e tempest-TestStampPattern-927079618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:13:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-d5d195e5-66c5-4188-8d3f-ff305e20479d req-1657bfa0-aef5-4e6d-b928-f95ed5a04a3e tempest-TestStampPattern-927079618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:13:04 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecf46fe-d43d-496e-905c-a49d24558176]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:13:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-d5d195e5-66c5-4188-8d3f-ff305e20479d req-1657bfa0-aef5-4e6d-b928-f95ed5a04a3e tempest-TestStampPattern-927079618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:13:04 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08 Jul 07 22:13:04 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:13:04 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Jul 07 22:13:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [req-d5d195e5-66c5-4188-8d3f-ff305e20479d req-1657bfa0-aef5-4e6d-b928-f95ed5a04a3e tempest-TestStampPattern-927079618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08" returned: 0 in 0.758s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:13:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [req-d5d195e5-66c5-4188-8d3f-ff305e20479d req-1657bfa0-aef5-4e6d-b928-f95ed5a04a3e tempest-TestStampPattern-927079618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.775s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:13:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-d5d195e5-66c5-4188-8d3f-ff305e20479d req-1657bfa0-aef5-4e6d-b928-f95ed5a04a3e tempest-TestStampPattern-927079618 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491', 'name': 'volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e93fea46-4302-4ebb-b102-60cff5cf4adc', 'enforce_multipath': True} {{(pid=87586) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4930}} Jul 07 22:13:05 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-d5d195e5-66c5-4188-8d3f-ff305e20479d req-1657bfa0-aef5-4e6d-b928-f95ed5a04a3e tempest-TestStampPattern-927079618 None] attachment_update completed successfully. Jul 07 22:13:11 devstack cinder-volume[87586]: INFO cinder.volume.manager [req-ed0870c1-c9d1-414d-858c-a6670249c359 req-20757166-066f-4b47-bd36-aa10d485205d tempest-TestStampPattern-927079618 None] Terminate volume connection completed successfully. Jul 07 22:13:11 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [req-ed0870c1-c9d1-414d-858c-a6670249c359 req-20757166-066f-4b47-bd36-aa10d485205d tempest-TestStampPattern-927079618 None] Deleting attachment e93fea46-4302-4ebb-b102-60cff5cf4adc. {{(pid=87586) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5061}} Jul 07 22:13:21 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:13:21 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:13:21 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9b2a99b9-e800-4f7f-a32a-76a248650b24 tempest-TestStampPattern-927079618 None] Acquiring lock "cinder-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:13:21 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9b2a99b9-e800-4f7f-a32a-76a248650b24 tempest-TestStampPattern-927079618 None] Lock "cinder-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:13:21 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9b2a99b9-e800-4f7f-a32a-76a248650b24 tempest-TestStampPattern-927079618 None] Acquiring lock "cinder-quobyte-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:13:21 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9b2a99b9-e800-4f7f-a32a-76a248650b24 tempest-TestStampPattern-927079618 None] Lock "cinder-quobyte-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08" acquired by "delete_volume" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:13:21 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[49823b03-d1ef-4f12-ab0f-fca948153461]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:13:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9b2a99b9-e800-4f7f-a32a-76a248650b24 tempest-TestStampPattern-927079618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:13:22 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08 Jul 07 22:13:22 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:13:22 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Jul 07 22:13:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9b2a99b9-e800-4f7f-a32a-76a248650b24 tempest-TestStampPattern-927079618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08" returned: 0 in 0.746s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:13:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9b2a99b9-e800-4f7f-a32a-76a248650b24 tempest-TestStampPattern-927079618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:13:22 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08 Jul 07 22:13:22 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:13:23 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Jul 07 22:13:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9b2a99b9-e800-4f7f-a32a-76a248650b24 tempest-TestStampPattern-927079618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08" returned: 0 in 0.646s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:13:23 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9b2a99b9-e800-4f7f-a32a-76a248650b24 tempest-TestStampPattern-927079618 None] Lock "cinder-quobyte-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08" released by "delete_volume" :: held 1.437s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:13:23 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-9b2a99b9-e800-4f7f-a32a-76a248650b24 tempest-TestStampPattern-927079618 None] Created reservations ['06c85762-bf17-45d7-84c5-29f7ed4c7e4b', '52936c6f-e1e2-4125-9a45-1c24cf41cfdc', '9b02b224-3d06-456c-b61c-ba59f1523cf2', 'b07abbde-c818-4c8e-9f7b-831a426b735d'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:13:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9b2a99b9-e800-4f7f-a32a-76a248650b24 tempest-TestStampPattern-927079618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:13:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9b2a99b9-e800-4f7f-a32a-76a248650b24 tempest-TestStampPattern-927079618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:13:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9b2a99b9-e800-4f7f-a32a-76a248650b24 tempest-TestStampPattern-927079618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:13:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9b2a99b9-e800-4f7f-a32a-76a248650b24 tempest-TestStampPattern-927079618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:13:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9b2a99b9-e800-4f7f-a32a-76a248650b24 tempest-TestStampPattern-927079618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:13:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9b2a99b9-e800-4f7f-a32a-76a248650b24 tempest-TestStampPattern-927079618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:13:23 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:13:23 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:13:24 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Jul 07 22:13:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9b2a99b9-e800-4f7f-a32a-76a248650b24 tempest-TestStampPattern-927079618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.647s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:13:24 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-9b2a99b9-e800-4f7f-a32a-76a248650b24 tempest-TestStampPattern-927079618 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:13:24 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-9b2a99b9-e800-4f7f-a32a-76a248650b24 tempest-TestStampPattern-927079618 None] Deleted volume successfully. Jul 07 22:13:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9b2a99b9-e800-4f7f-a32a-76a248650b24 tempest-TestStampPattern-927079618 None] Lock "cinder-48f2a0af-3d5b-4ec8-89f6-a57d2e118b08-delete_volume" released by "delete_volume" :: held 2.307s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:13:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-767a39e2-5f9a-458f-a588-8c263332953d tempest-TestStampPattern-927079618 None] Acquiring lock "cinder-5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:13:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-767a39e2-5f9a-458f-a588-8c263332953d tempest-TestStampPattern-927079618 None] Lock "cinder-5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:13:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-767a39e2-5f9a-458f-a588-8c263332953d tempest-TestStampPattern-927079618 None] Acquiring lock "cinder-quobyte-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:13:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-767a39e2-5f9a-458f-a588-8c263332953d tempest-TestStampPattern-927079618 None] Lock "cinder-quobyte-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:13:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-767a39e2-5f9a-458f-a588-8c263332953d tempest-TestStampPattern-927079618 None] Acquiring lock "cinder-quobyte-5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:13:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-767a39e2-5f9a-458f-a588-8c263332953d tempest-TestStampPattern-927079618 None] Lock "cinder-quobyte-5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:13:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-767a39e2-5f9a-458f-a588-8c263332953d tempest-TestStampPattern-927079618 None] Deleting offline snapshot 5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e of volume ec7812a9-7c84-4834-b5b8-af8a29b8bdcd {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:13:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-767a39e2-5f9a-458f-a588-8c263332953d tempest-TestStampPattern-927079618 None] snapshot_file for this snap is: volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:13:24 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[385eacaa-565b-467a-b2a7-f383b0a9c589]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:13:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-767a39e2-5f9a-458f-a588-8c263332953d tempest-TestStampPattern-927079618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:13:24 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e Jul 07 22:13:24 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:13:25 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Jul 07 22:13:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-767a39e2-5f9a-458f-a588-8c263332953d tempest-TestStampPattern-927079618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e" returned: 0 in 0.731s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:13:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-767a39e2-5f9a-458f-a588-8c263332953d tempest-TestStampPattern-927079618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:13:25 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[51802854-cf7d-4066-8679-32d964fc22a0]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:13:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-767a39e2-5f9a-458f-a588-8c263332953d tempest-TestStampPattern-927079618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:13:25 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd Jul 07 22:13:25 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:13:25 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Jul 07 22:13:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-767a39e2-5f9a-458f-a588-8c263332953d tempest-TestStampPattern-927079618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd" returned: 0 in 0.717s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:13:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-767a39e2-5f9a-458f-a588-8c263332953d tempest-TestStampPattern-927079618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:13:25 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e Jul 07 22:13:25 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:13:26 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Jul 07 22:13:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-767a39e2-5f9a-458f-a588-8c263332953d tempest-TestStampPattern-927079618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e" returned: 0 in 0.696s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:13:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-767a39e2-5f9a-458f-a588-8c263332953d tempest-TestStampPattern-927079618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:13:26 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e Jul 07 22:13:26 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:13:27 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Jul 07 22:13:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-767a39e2-5f9a-458f-a588-8c263332953d tempest-TestStampPattern-927079618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd.5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e" returned: 0 in 0.626s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:13:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-767a39e2-5f9a-458f-a588-8c263332953d tempest-TestStampPattern-927079618 None] Lock "cinder-quobyte-5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e" released by "_delete_snapshot" :: held 2.863s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:13:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-767a39e2-5f9a-458f-a588-8c263332953d tempest-TestStampPattern-927079618 None] Lock "cinder-quobyte-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd" released by "delete_snapshot" :: held 2.881s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:13:27 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-767a39e2-5f9a-458f-a588-8c263332953d tempest-TestStampPattern-927079618 None] Created reservations ['103b1576-dd9e-44cf-9794-02d1818f6d3f', 'a8668f02-07fc-4e60-b0dc-f767b2106e2e', '189ae2bc-195a-4155-bfab-c6a20da0fa4b', '290a35b5-c232-4efa-99d8-a342fde49fff'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:13:27 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-767a39e2-5f9a-458f-a588-8c263332953d tempest-TestStampPattern-927079618 None] Delete snapshot completed successfully. Jul 07 22:13:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-767a39e2-5f9a-458f-a588-8c263332953d tempest-TestStampPattern-927079618 None] Lock "cinder-5fa21948-cce1-4dbb-b89a-a73a0f1d0d1e-delete_snapshot" released by "delete_snapshot" :: held 3.010s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:13:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9d424529-326b-42a4-8d2c-462295b5b0a8 tempest-TestStampPattern-927079618 None] Acquiring lock "cinder-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:13:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9d424529-326b-42a4-8d2c-462295b5b0a8 tempest-TestStampPattern-927079618 None] Lock "cinder-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:13:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9d424529-326b-42a4-8d2c-462295b5b0a8 tempest-TestStampPattern-927079618 None] Acquiring lock "cinder-quobyte-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:13:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9d424529-326b-42a4-8d2c-462295b5b0a8 tempest-TestStampPattern-927079618 None] Lock "cinder-quobyte-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd" acquired by "delete_volume" :: waited 0.014s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:13:34 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f010a0-24b7-4145-991b-64d1c2294ed1]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:13:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d424529-326b-42a4-8d2c-462295b5b0a8 tempest-TestStampPattern-927079618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:13:34 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd Jul 07 22:13:34 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:13:35 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Jul 07 22:13:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d424529-326b-42a4-8d2c-462295b5b0a8 tempest-TestStampPattern-927079618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd" returned: 0 in 0.772s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:13:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d424529-326b-42a4-8d2c-462295b5b0a8 tempest-TestStampPattern-927079618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:13:35 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd Jul 07 22:13:35 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:13:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:13:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:13:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:13:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:13:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:13:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:13:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:13:35 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:13:35 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:13:36 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Jul 07 22:13:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d424529-326b-42a4-8d2c-462295b5b0a8 tempest-TestStampPattern-927079618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd" returned: 0 in 0.655s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:13:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9d424529-326b-42a4-8d2c-462295b5b0a8 tempest-TestStampPattern-927079618 None] Lock "cinder-quobyte-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd" released by "delete_volume" :: held 1.494s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:13:36 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-9d424529-326b-42a4-8d2c-462295b5b0a8 tempest-TestStampPattern-927079618 None] Created reservations ['ce86c0e0-1e91-4964-b493-1ea98cbb318c', '3886dbcf-d6d2-43cb-8228-41ff3fe8726c', '362f8fc1-e8a8-4f80-9488-5f5d48b69e88', 'df1bb295-7a09-4c4c-9417-e5848334947b'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:13:36 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Jul 07 22:13:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.648s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:13:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:13:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9d424529-326b-42a4-8d2c-462295b5b0a8 tempest-TestStampPattern-927079618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:13:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9d424529-326b-42a4-8d2c-462295b5b0a8 tempest-TestStampPattern-927079618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:13:36 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9d424529-326b-42a4-8d2c-462295b5b0a8 tempest-TestStampPattern-927079618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:13:36 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9d424529-326b-42a4-8d2c-462295b5b0a8 tempest-TestStampPattern-927079618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:13:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9d424529-326b-42a4-8d2c-462295b5b0a8 tempest-TestStampPattern-927079618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:13:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d424529-326b-42a4-8d2c-462295b5b0a8 tempest-TestStampPattern-927079618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:13:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:13:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 28 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 22:13:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 22:13:36 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:13:36 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:13:36 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Jul 07 22:13:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d424529-326b-42a4-8d2c-462295b5b0a8 tempest-TestStampPattern-927079618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.617s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:13:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-9d424529-326b-42a4-8d2c-462295b5b0a8 tempest-TestStampPattern-927079618 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:13:36 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-9d424529-326b-42a4-8d2c-462295b5b0a8 tempest-TestStampPattern-927079618 None] Deleted volume successfully. Jul 07 22:13:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9d424529-326b-42a4-8d2c-462295b5b0a8 tempest-TestStampPattern-927079618 None] Lock "cinder-ec7812a9-7c84-4834-b5b8-af8a29b8bdcd-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:13:46 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=17,cinder:UPDATE=24,cinder:INSERT=5 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:13:46 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=15,cinder:UPDATE=20,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:13:56 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:13:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Flow 'volume_create_manager' (48788318-1339-4900-8eca-3041abf95659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:13:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a0ceb0-d211-4874-99b4-dd0bd3ff9ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:13:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a0ceb0-d211-4874-99b4-dd0bd3ff9ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71548c7bd03848b8a535e423215fbcb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:13:56Z,use_quota=True,user_id='9cb7d9f3cd3440f2810c7c765a376c24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(195c36f5-e1f4-4620-b7ed-040bdbd9b0f5),volume_type_id=195c36f5-e1f4-4620-b7ed-040bdbd9b0f5)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:13:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15aecb1-1fb8-4084-be72-b6872d135e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:13:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15aecb1-1fb8-4084-be72-b6872d135e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:13:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd318d70-fb21-4640-92c7-8205d860ad7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:13:56 devstack cinder-volume[87586]: DEBUG cinder.image.glance [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Creating Keystone auth plugin from conf {{(pid=87586) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:13:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd318d70-fb21-4640-92c7-8205d860ad7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9', 'volume_name': 'volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9', 'volume_size': 1, 'image_id': 'e04f22b8-938b-4d2d-a4f6-5b77725f2388', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e04f22b8-938b-4d2d-a4f6-5b77725f2388', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '33b86a8cd914db895911baf41034d63f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '71548c7bd03848b8a535e423215fbcb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'baec5e33206d2fd48a1cea221bc933d04288ca9e26e9ce8b15695443fde26918dd4961fc11ccd9389f3f375366130593324a93c542d73b0be688b75f33630c19', 'id': 'e04f22b8-938b-4d2d-a4f6-5b77725f2388', 'created_at': datetime.datetime(2026, 7, 7, 20, 13, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 13, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e04f22b8-938b-4d2d-a4f6-5b77725f2388/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:13:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd9ac67-b651-415b-b7be-41ebc215a78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:13:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd9ac67-b651-415b-b7be-41ebc215a78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:13:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03bef974-14ae-4afa-861e-4c5bfd719bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:13:56 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Volume e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9', 'volume_size': 1, 'image_id': 'e04f22b8-938b-4d2d-a4f6-5b77725f2388', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e04f22b8-938b-4d2d-a4f6-5b77725f2388', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '33b86a8cd914db895911baf41034d63f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '71548c7bd03848b8a535e423215fbcb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'baec5e33206d2fd48a1cea221bc933d04288ca9e26e9ce8b15695443fde26918dd4961fc11ccd9389f3f375366130593324a93c542d73b0be688b75f33630c19', 'id': 'e04f22b8-938b-4d2d-a4f6-5b77725f2388', 'created_at': datetime.datetime(2026, 7, 7, 20, 13, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 13, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e04f22b8-938b-4d2d-a4f6-5b77725f2388/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 22:13:56 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Trying to clone e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 from image e04f22b8-938b-4d2d-a4f6-5b77725f2388 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e04f22b8-938b-4d2d-a4f6-5b77725f2388', 'metadata': {}}]). {{(pid=87586) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:13:56 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:13:56 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Image download 0.00 MB at 0.00 MB/s Jul 07 22:13:56 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6528c7-dfa9-4fbf-9611-95737f56c6c0]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:13:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:13:56 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD Jul 07 22:13:56 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:13:57 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Jul 07 22:13:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD" returned: 0 in 0.748s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:13:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:13:57 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD Jul 07 22:13:57 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:13:58 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Jul 07 22:13:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD" returned: 1 in 0.726s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:13:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:13:58 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Temporary image e04f22b8-938b-4d2d-a4f6-5b77725f2388 is fetched for user 9cb7d9f3cd3440f2810c7c765a376c24. {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:13:58 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24a5637-3f8d-4c55-ab9b-16a7ce6ac899]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:13:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:13:58 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD Jul 07 22:13:58 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:13:58 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Jul 07 22:13:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD" returned: 0 in 0.728s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:13:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:13:59 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD Jul 07 22:13:59 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:13:59 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Jul 07 22:13:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD" returned: 1 in 0.695s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:13:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:13:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:13:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:13:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71548c7bd03848b8a535e423215fbcb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:13:56Z,use_quota=True,user_id='9cb7d9f3cd3440f2810c7c765a376c24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(195c36f5-e1f4-4620-b7ed-040bdbd9b0f5),volume_type_id=195c36f5-e1f4-4620-b7ed-040bdbd9b0f5)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:13:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Creating volume e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:13:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:13:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:13:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:13:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:13:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:13:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:13:59 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:13:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:13:59 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 1073741824 Jul 07 22:13:59 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:00 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 1073741824" returned: 0 in 0.835s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:00 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 Jul 07 22:14:00 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:01 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9" returned: 0 in 0.660s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:01 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:14:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:01 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Attempting download of e04f22b8-938b-4d2d-a4f6-5b77725f2388 ((None, [{'url': 'file:///opt/stack/data/glance/images/e04f22b8-938b-4d2d-a4f6-5b77725f2388', 'metadata': {}}])) to volume e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9. {{(pid=87586) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:14:01 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8c7f05-fafe-40a1-8c13-02bbdb54c13b]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:14:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e04f22b8-938b-4d2d-a4f6-5b77725f2388_pelj6kcy {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:01 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e04f22b8-938b-4d2d-a4f6-5b77725f2388_pelj6kcy Jul 07 22:14:01 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:01 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e04f22b8-938b-4d2d-a4f6-5b77725f2388_pelj6kcy" returned: 0 in 0.769s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e04f22b8-938b-4d2d-a4f6-5b77725f2388_pelj6kcy {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:02 devstack sudo[104600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e04f22b8-938b-4d2d-a4f6-5b77725f2388_pelj6kcy Jul 07 22:14:02 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:02 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e04f22b8-938b-4d2d-a4f6-5b77725f2388_pelj6kcy" returned: 1 in 0.740s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e04f22b8-938b-4d2d-a4f6-5b77725f2388_pelj6kcy' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:14:02 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4fc25c-7342-4944-a140-57cc29df66f2]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:14:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:02 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD Jul 07 22:14:02 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:03 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD" returned: 0 in 0.733s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:03 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD Jul 07 22:14:03 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:04 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD" returned: 1 in 0.738s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:14:04 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] e04f22b8-938b-4d2d-a4f6-5b77725f2388 was raw, converting to raw {{(pid=87586) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:14:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:04 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 Jul 07 22:14:04 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:04 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9" returned: 0 in 0.702s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:04 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e04f22b8-938b-4d2d-a4f6-5b77725f2388_ihse15ejdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:14:04 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 22:14:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:04 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 1G Jul 07 22:14:04 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:05 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 1G" returned: 0 in 0.644s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:05 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ade1ac-268a-4922-b14b-95125b36ce96]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:14:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:05 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 Jul 07 22:14:05 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:06 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9" returned: 0 in 0.720s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:06 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 Jul 07 22:14:06 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:07 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9" returned: 1 in 0.788s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:14:07 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Downloaded image e04f22b8-938b-4d2d-a4f6-5b77725f2388 ((None, [{'url': 'file:///opt/stack/data/glance/images/e04f22b8-938b-4d2d-a4f6-5b77725f2388', 'metadata': {}}])) to volume e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 successfully. {{(pid=87586) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:14:07 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Temporary image e04f22b8-938b-4d2d-a4f6-5b77725f2388 for user 9cb7d9f3cd3440f2810c7c765a376c24 is deleted. {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:14:07 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Marking volume e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 as bootable. {{(pid=87586) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:14:07 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Copying metadata from image e04f22b8-938b-4d2d-a4f6-5b77725f2388 to e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9. {{(pid=87586) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:14:07 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Creating volume glance metadata for volume e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 backed by image e04f22b8-938b-4d2d-a4f6-5b77725f2388 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e04f22b8-938b-4d2d-a4f6-5b77725f2388', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '33b86a8cd914db895911baf41034d63f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87586) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:14:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03bef974-14ae-4afa-861e-4c5bfd719bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9', 'volume_size': 1, 'image_id': 'e04f22b8-938b-4d2d-a4f6-5b77725f2388', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e04f22b8-938b-4d2d-a4f6-5b77725f2388', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '33b86a8cd914db895911baf41034d63f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '71548c7bd03848b8a535e423215fbcb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'baec5e33206d2fd48a1cea221bc933d04288ca9e26e9ce8b15695443fde26918dd4961fc11ccd9389f3f375366130593324a93c542d73b0be688b75f33630c19', 'id': 'e04f22b8-938b-4d2d-a4f6-5b77725f2388', 'created_at': datetime.datetime(2026, 7, 7, 20, 13, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 13, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e04f22b8-938b-4d2d-a4f6-5b77725f2388/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27be26b-2ae1-4d0e-856c-081c626aa0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:07 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Volume volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 (e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9): created successfully Jul 07 22:14:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27be26b-2ae1-4d0e-856c-081c626aa0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Flow 'volume_create_manager' (48788318-1339-4900-8eca-3041abf95659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:14:07 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-dde1c800-f616-4ceb-b414-a33364460420 tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Created volume successfully. Jul 07 22:14:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Acquiring lock "cinder-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:14:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Lock "cinder-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:14:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Acquiring lock "cinder-quobyte-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:14:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Lock "cinder-quobyte-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9" acquired by "delete_volume" :: waited 0.014s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:14:07 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4354243-61c0-447d-b200-4d322d5fbbcb]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:14:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:07 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 Jul 07 22:14:07 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:08 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9" returned: 0 in 0.743s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:08 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 Jul 07 22:14:08 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:09 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9" returned: 1 in 0.726s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:14:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:09 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9 Jul 07 22:14:09 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:09 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9" returned: 0 in 0.652s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:09 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Lock "cinder-quobyte-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9" released by "delete_volume" :: held 2.178s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:14:10 devstack cinder-volume[87586]: WARNING cinder.quota [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:14:10 devstack cinder-volume[87586]: WARNING cinder.quota [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 22:14:10 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Created reservations ['2c037634-0dc2-47fc-ae13-dd4854c6ce3f', '85d7078b-41d7-4f4e-be07-08866d8b0548', '4094f18f-5de2-4ef5-987a-d34125071f11', 'e8cb135e-2ee4-4076-b415-dfd7d8ce8754'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:14:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:14:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:14:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:10 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:14:10 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:10 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.632s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:10 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:14:10 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Deleted volume successfully. Jul 07 22:14:10 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-015f543e-e6fe-4737-9a11-e2c2a14d078c tempest-VolumeAndVolumeTypeFromImageTest-383695504 None] Lock "cinder-e8762b2f-e2ad-4ebb-bcbb-6b3aafc1a4b9-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Flow 'volume_create_manager' (466dbe69-ed2f-49de-92dd-132d15b43326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30d1d0c-9c0a-4199-948b-e9d452b40491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30d1d0c-9c0a-4199-948b-e9d452b40491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1048436913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ed6e8e-3d37-428d-be03-38fcf35b0e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d08b43c10dd4430ac81a14334851c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:14:15Z,use_quota=True,user_id='92dd47005a8a4438a9abfdf226f51325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b859fd46-f81b-4a62-ac15-908b58000bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b859fd46-f81b-4a62-ac15-908b58000bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02bbe966-bee5-41ba-890c-6b3a75a6d03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02bbe966-bee5-41ba-890c-6b3a75a6d03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34ed6e8e-3d37-428d-be03-38fcf35b0e22', 'volume_name': 'volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b12c635-f12e-439e-be62-9e3287c2dbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b12c635-f12e-439e-be62-9e3287c2dbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697f12e3-aa0c-48e0-841d-13553f100b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:15 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Volume 34ed6e8e-3d37-428d-be03-38fcf35b0e22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22', 'volume_size': 1} Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1048436913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ed6e8e-3d37-428d-be03-38fcf35b0e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d08b43c10dd4430ac81a14334851c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:14:15Z,use_quota=True,user_id='92dd47005a8a4438a9abfdf226f51325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Creating volume 34ed6e8e-3d37-428d-be03-38fcf35b0e22 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:14:15 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:15 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22 1073741824 Jul 07 22:14:15 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:15 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22 1073741824" returned: 0 in 0.794s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:15 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22 Jul 07 22:14:15 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:16 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22" returned: 0 in 0.623s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:14:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697f12e3-aa0c-48e0-841d-13553f100b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d3f613-8607-42e5-bc50-d8919b07433b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:16 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Volume volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22 (34ed6e8e-3d37-428d-be03-38fcf35b0e22): created successfully Jul 07 22:14:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d3f613-8607-42e5-bc50-d8919b07433b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Flow 'volume_create_manager' (466dbe69-ed2f-49de-92dd-132d15b43326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:14:16 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ae30aa63-c0b6-4771-b889-977280d4395b tempest-CreateVolumesFromSnapshotTest-1671640564 None] Created volume successfully. Jul 07 22:14:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9237daec-b3e8-422b-b2f2-35ed89e067c2 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9237daec-b3e8-422b-b2f2-35ed89e067c2 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:17 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-9237daec-b3e8-422b-b2f2-35ed89e067c2 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Creating offline snapshot 4d4f3748-7c6f-4c75-8b79-471dfbcd6c82 of volume 34ed6e8e-3d37-428d-be03-38fcf35b0e22 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:14:17 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7944459-8d90-44ae-b9ba-1f5afd3e23e7]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:14:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9237daec-b3e8-422b-b2f2-35ed89e067c2 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:17 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22 Jul 07 22:14:17 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:18 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9237daec-b3e8-422b-b2f2-35ed89e067c2 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22" returned: 0 in 0.732s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9237daec-b3e8-422b-b2f2-35ed89e067c2 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.4d4f3748-7c6f-4c75-8b79-471dfbcd6c82 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:18 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.4d4f3748-7c6f-4c75-8b79-471dfbcd6c82 1G Jul 07 22:14:18 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:18 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9237daec-b3e8-422b-b2f2-35ed89e067c2 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.4d4f3748-7c6f-4c75-8b79-471dfbcd6c82 1G" returned: 0 in 0.773s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9237daec-b3e8-422b-b2f2-35ed89e067c2 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.4d4f3748-7c6f-4c75-8b79-471dfbcd6c82 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:18 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.4d4f3748-7c6f-4c75-8b79-471dfbcd6c82 Jul 07 22:14:18 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:19 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9237daec-b3e8-422b-b2f2-35ed89e067c2 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.4d4f3748-7c6f-4c75-8b79-471dfbcd6c82" returned: 0 in 0.675s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:19 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-9237daec-b3e8-422b-b2f2-35ed89e067c2 tempest-CreateVolumesFromSnapshotTest-1671640564 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.4d4f3748-7c6f-4c75-8b79-471dfbcd6c82 is being set with open permissions: ugo+rw Jul 07 22:14:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9237daec-b3e8-422b-b2f2-35ed89e067c2 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.4d4f3748-7c6f-4c75-8b79-471dfbcd6c82 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:19 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.4d4f3748-7c6f-4c75-8b79-471dfbcd6c82 Jul 07 22:14:19 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:20 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9237daec-b3e8-422b-b2f2-35ed89e067c2 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.4d4f3748-7c6f-4c75-8b79-471dfbcd6c82" returned: 0 in 0.631s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9237daec-b3e8-422b-b2f2-35ed89e067c2 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:20 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.info Jul 07 22:14:20 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:20 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9237daec-b3e8-422b-b2f2-35ed89e067c2 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.info" returned: 0 in 0.632s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:20 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-9237daec-b3e8-422b-b2f2-35ed89e067c2 tempest-CreateVolumesFromSnapshotTest-1671640564 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.info is being set with open permissions: ugo+rw Jul 07 22:14:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9237daec-b3e8-422b-b2f2-35ed89e067c2 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:20 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.info Jul 07 22:14:20 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:21 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9237daec-b3e8-422b-b2f2-35ed89e067c2 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.info" returned: 0 in 0.643s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9237daec-b3e8-422b-b2f2-35ed89e067c2 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.168s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:21 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-9237daec-b3e8-422b-b2f2-35ed89e067c2 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Create snapshot completed successfully Jul 07 22:14:22 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:14:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Flow 'volume_create_manager' (1bd0bde8-fced-49bf-857a-b7847ac6b263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:14:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d6c8ba-036f-45d2-b4fd-6fb6671a34a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d6c8ba-036f-45d2-b4fd-6fb6671a34a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1652426922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6f6dd7-5c4f-48eb-85d1-f947df3ee963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d08b43c10dd4430ac81a14334851c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:14:23Z,use_quota=True,user_id='92dd47005a8a4438a9abfdf226f51325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29bf4f66-33b0-4302-b026-cedb53661810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29bf4f66-33b0-4302-b026-cedb53661810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b90dd1-9039-4071-8212-baa7f7f7bca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b90dd1-9039-4071-8212-baa7f7f7bca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab6f6dd7-5c4f-48eb-85d1-f947df3ee963', 'volume_name': 'volume-ab6f6dd7-5c4f-48eb-85d1-f947df3ee963', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d63ee4b-2f24-4d0a-a4da-69ae32b3f715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d63ee4b-2f24-4d0a-a4da-69ae32b3f715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b2b37f3-5417-49e1-995a-5d8f13821505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:23 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Volume ab6f6dd7-5c4f-48eb-85d1-f947df3ee963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab6f6dd7-5c4f-48eb-85d1-f947df3ee963', 'volume_size': 1} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1652426922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6f6dd7-5c4f-48eb-85d1-f947df3ee963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d08b43c10dd4430ac81a14334851c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:14:23Z,use_quota=True,user_id='92dd47005a8a4438a9abfdf226f51325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Creating volume ab6f6dd7-5c4f-48eb-85d1-f947df3ee963 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:14:23 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6f6dd7-5c4f-48eb-85d1-f947df3ee963 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:23 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6f6dd7-5c4f-48eb-85d1-f947df3ee963 1073741824 Jul 07 22:14:23 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Flow 'volume_create_manager' (44a7796a-07bb-42ed-af18-2de551982043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf822173-ab8b-4f0f-b023-19a28c2e1156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf822173-ab8b-4f0f-b023-19a28c2e1156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1347093671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd1ada4-116d-4a73-aafe-61a6e5b7f246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d08b43c10dd4430ac81a14334851c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:14:23Z,use_quota=True,user_id='92dd47005a8a4438a9abfdf226f51325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a33a19-4e1f-45c8-9b52-194241cf00b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a33a19-4e1f-45c8-9b52-194241cf00b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf54395-ed6d-4a15-b6d0-9a7c938191b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf54395-ed6d-4a15-b6d0-9a7c938191b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fd1ada4-116d-4a73-aafe-61a6e5b7f246', 'volume_name': 'volume-8fd1ada4-116d-4a73-aafe-61a6e5b7f246', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2ef9cb-01bd-46a3-8009-ac6c91d8f1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2ef9cb-01bd-46a3-8009-ac6c91d8f1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd7b6669-9bd5-4d2a-8295-dd62b49158f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:23 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Volume 8fd1ada4-116d-4a73-aafe-61a6e5b7f246: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fd1ada4-116d-4a73-aafe-61a6e5b7f246', 'volume_size': 1} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Flow 'volume_create_manager' (87c39504-a9ca-4f47-b179-c62bba688dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b7935d-1f24-4c98-8ecf-e51bbdf73ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b7935d-1f24-4c98-8ecf-e51bbdf73ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-465680200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30240ef6-0e68-481b-8817-f7ce1f116c46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d08b43c10dd4430ac81a14334851c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:14:24Z,use_quota=True,user_id='92dd47005a8a4438a9abfdf226f51325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1409b6-d4c4-4b0f-a2c4-89acc230ecd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1409b6-d4c4-4b0f-a2c4-89acc230ecd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f92b34c-006a-4484-b56e-952ed3f7e3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f92b34c-006a-4484-b56e-952ed3f7e3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30240ef6-0e68-481b-8817-f7ce1f116c46', 'volume_name': 'volume-30240ef6-0e68-481b-8817-f7ce1f116c46', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008c6f87-ff7f-4e9d-9398-64803d75ffb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008c6f87-ff7f-4e9d-9398-64803d75ffb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2808b0a5-775e-4455-bd30-71aa27d1c808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:23 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Volume 30240ef6-0e68-481b-8817-f7ce1f116c46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30240ef6-0e68-481b-8817-f7ce1f116c46', 'volume_size': 1} Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:23 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6f6dd7-5c4f-48eb-85d1-f947df3ee963 1073741824" returned: 0 in 0.952s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6f6dd7-5c4f-48eb-85d1-f947df3ee963 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:24 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6f6dd7-5c4f-48eb-85d1-f947df3ee963 Jul 07 22:14:24 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Flow 'volume_create_manager' (9fa29384-9915-41e6-b3c5-d85d80ae99fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33bffd58-2b63-44cd-abc3-c8901a62b5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33bffd58-2b63-44cd-abc3-c8901a62b5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1153700912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d902b78-0a7f-497a-9518-be38b0762a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d08b43c10dd4430ac81a14334851c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:14:24Z,use_quota=True,user_id='92dd47005a8a4438a9abfdf226f51325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce495ba4-fce5-425a-ba65-ce017a3c42d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce495ba4-fce5-425a-ba65-ce017a3c42d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139c82b2-39bc-4c0e-8e5a-e368bd2b96d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139c82b2-39bc-4c0e-8e5a-e368bd2b96d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d902b78-0a7f-497a-9518-be38b0762a7e', 'volume_name': 'volume-2d902b78-0a7f-497a-9518-be38b0762a7e', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a2fde0-1131-449e-a755-1efb8034d5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a2fde0-1131-449e-a755-1efb8034d5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01295a7c-97f9-4158-9032-9f60a27a3e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:24 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Volume 2d902b78-0a7f-497a-9518-be38b0762a7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d902b78-0a7f-497a-9518-be38b0762a7e', 'volume_size': 1} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Flow 'volume_create_manager' (0c3bc88c-023e-4bb1-baab-80d1403bbf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7826d82-2f65-4e94-941d-8d7d254da5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7826d82-2f65-4e94-941d-8d7d254da5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2128762911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086970e9-0242-4ffb-8122-bc1d0c2ffc00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d08b43c10dd4430ac81a14334851c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:14:24Z,use_quota=True,user_id='92dd47005a8a4438a9abfdf226f51325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246051c2-b8a2-4774-aee2-d80f40814dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246051c2-b8a2-4774-aee2-d80f40814dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bfb88c9-2921-4c86-bc2d-7539b3d1def9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bfb88c9-2921-4c86-bc2d-7539b3d1def9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '086970e9-0242-4ffb-8122-bc1d0c2ffc00', 'volume_name': 'volume-086970e9-0242-4ffb-8122-bc1d0c2ffc00', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a35cbb-070e-4c2f-9d29-aa10bcd34cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a35cbb-070e-4c2f-9d29-aa10bcd34cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79db4fc0-5525-4bfa-bbf3-7a67bf0fe50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:24 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Volume 086970e9-0242-4ffb-8122-bc1d0c2ffc00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-086970e9-0242-4ffb-8122-bc1d0c2ffc00', 'volume_size': 1} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:24 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6f6dd7-5c4f-48eb-85d1-f947df3ee963" returned: 0 in 0.736s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.332s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1347093671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd1ada4-116d-4a73-aafe-61a6e5b7f246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d08b43c10dd4430ac81a14334851c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:14:23Z,use_quota=True,user_id='92dd47005a8a4438a9abfdf226f51325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Creating volume 8fd1ada4-116d-4a73-aafe-61a6e5b7f246 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:14:24 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8fd1ada4-116d-4a73-aafe-61a6e5b7f246 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:24 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8fd1ada4-116d-4a73-aafe-61a6e5b7f246 1073741824 Jul 07 22:14:24 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b2b37f3-5417-49e1-995a-5d8f13821505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab6f6dd7-5c4f-48eb-85d1-f947df3ee963', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7587a243-63fa-4202-8734-575766bb02e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:24 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Volume volume-ab6f6dd7-5c4f-48eb-85d1-f947df3ee963 (ab6f6dd7-5c4f-48eb-85d1-f947df3ee963): created successfully Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7587a243-63fa-4202-8734-575766bb02e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:24 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Flow 'volume_create_manager' (1bd0bde8-fced-49bf-857a-b7847ac6b263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:14:24 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-e2ab0e28-7ee4-4ab1-b6c9-57ce07020875 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Created volume successfully. Jul 07 22:14:25 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8fd1ada4-116d-4a73-aafe-61a6e5b7f246 1073741824" returned: 0 in 0.861s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8fd1ada4-116d-4a73-aafe-61a6e5b7f246 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:25 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8fd1ada4-116d-4a73-aafe-61a6e5b7f246 Jul 07 22:14:25 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:26 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8fd1ada4-116d-4a73-aafe-61a6e5b7f246" returned: 0 in 0.637s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:14:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.527s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-465680200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30240ef6-0e68-481b-8817-f7ce1f116c46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d08b43c10dd4430ac81a14334851c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:14:24Z,use_quota=True,user_id='92dd47005a8a4438a9abfdf226f51325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:14:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Creating volume 30240ef6-0e68-481b-8817-f7ce1f116c46 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:14:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:14:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:14:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:14:26 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:14:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-30240ef6-0e68-481b-8817-f7ce1f116c46 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd7b6669-9bd5-4d2a-8295-dd62b49158f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fd1ada4-116d-4a73-aafe-61a6e5b7f246', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:26 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-30240ef6-0e68-481b-8817-f7ce1f116c46 1073741824 Jul 07 22:14:26 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522c6824-8ef7-4989-a593-df55065446b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:26 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Volume volume-8fd1ada4-116d-4a73-aafe-61a6e5b7f246 (8fd1ada4-116d-4a73-aafe-61a6e5b7f246): created successfully Jul 07 22:14:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522c6824-8ef7-4989-a593-df55065446b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:26 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Flow 'volume_create_manager' (44a7796a-07bb-42ed-af18-2de551982043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:14:26 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-8f554f49-ee59-4821-846b-e0fd96f39211 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Created volume successfully. Jul 07 22:14:27 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-30240ef6-0e68-481b-8817-f7ce1f116c46 1073741824" returned: 0 in 0.824s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-30240ef6-0e68-481b-8817-f7ce1f116c46 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:27 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-30240ef6-0e68-481b-8817-f7ce1f116c46 Jul 07 22:14:27 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:27 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-30240ef6-0e68-481b-8817-f7ce1f116c46" returned: 0 in 0.634s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:27 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:14:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.626s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:27 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1153700912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d902b78-0a7f-497a-9518-be38b0762a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d08b43c10dd4430ac81a14334851c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:14:24Z,use_quota=True,user_id='92dd47005a8a4438a9abfdf226f51325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:14:27 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Creating volume 2d902b78-0a7f-497a-9518-be38b0762a7e {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:14:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:27 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:14:27 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:14:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:27 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:14:27 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:14:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d902b78-0a7f-497a-9518-be38b0762a7e 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:27 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2808b0a5-775e-4455-bd30-71aa27d1c808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30240ef6-0e68-481b-8817-f7ce1f116c46', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:27 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d902b78-0a7f-497a-9518-be38b0762a7e 1073741824 Jul 07 22:14:27 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:27 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da28ab09-4ea7-479d-99a9-3725197905e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:27 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Volume volume-30240ef6-0e68-481b-8817-f7ce1f116c46 (30240ef6-0e68-481b-8817-f7ce1f116c46): created successfully Jul 07 22:14:27 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da28ab09-4ea7-479d-99a9-3725197905e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:27 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Flow 'volume_create_manager' (87c39504-a9ca-4f47-b179-c62bba688dc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:14:27 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-316a96c5-5497-4daa-b83f-902bbf4caea8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Created volume successfully. Jul 07 22:14:28 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d902b78-0a7f-497a-9518-be38b0762a7e 1073741824" returned: 0 in 0.795s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d902b78-0a7f-497a-9518-be38b0762a7e {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:28 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d902b78-0a7f-497a-9518-be38b0762a7e Jul 07 22:14:28 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:29 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d902b78-0a7f-497a-9518-be38b0762a7e" returned: 0 in 0.622s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:29 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:14:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.682s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:29 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2128762911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086970e9-0242-4ffb-8122-bc1d0c2ffc00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d08b43c10dd4430ac81a14334851c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:14:24Z,use_quota=True,user_id='92dd47005a8a4438a9abfdf226f51325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:14:29 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Creating volume 086970e9-0242-4ffb-8122-bc1d0c2ffc00 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:14:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:29 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:14:29 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:14:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:29 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:14:29 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:14:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-086970e9-0242-4ffb-8122-bc1d0c2ffc00 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:29 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01295a7c-97f9-4158-9032-9f60a27a3e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d902b78-0a7f-497a-9518-be38b0762a7e', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:29 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-086970e9-0242-4ffb-8122-bc1d0c2ffc00 1073741824 Jul 07 22:14:29 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:29 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81426be9-e91c-4c2f-b769-8a44f9a16c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:29 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Volume volume-2d902b78-0a7f-497a-9518-be38b0762a7e (2d902b78-0a7f-497a-9518-be38b0762a7e): created successfully Jul 07 22:14:29 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81426be9-e91c-4c2f-b769-8a44f9a16c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:29 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Flow 'volume_create_manager' (9fa29384-9915-41e6-b3c5-d85d80ae99fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:14:29 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-086ed871-d888-4828-8824-037f027c647d tempest-CreateVolumesFromSnapshotTest-1671640564 None] Created volume successfully. Jul 07 22:14:30 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-086970e9-0242-4ffb-8122-bc1d0c2ffc00 1073741824" returned: 0 in 0.781s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-086970e9-0242-4ffb-8122-bc1d0c2ffc00 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:30 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-086970e9-0242-4ffb-8122-bc1d0c2ffc00 Jul 07 22:14:30 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:30 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-086970e9-0242-4ffb-8122-bc1d0c2ffc00" returned: 0 in 0.619s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:14:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79db4fc0-5525-4bfa-bbf3-7a67bf0fe50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-086970e9-0242-4ffb-8122-bc1d0c2ffc00', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b7ff8d-574f-4bb9-a12b-c0edcc337dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:30 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Volume volume-086970e9-0242-4ffb-8122-bc1d0c2ffc00 (086970e9-0242-4ffb-8122-bc1d0c2ffc00): created successfully Jul 07 22:14:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b7ff8d-574f-4bb9-a12b-c0edcc337dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Flow 'volume_create_manager' (0c3bc88c-023e-4bb1-baab-80d1403bbf92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:14:30 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-80f89497-0cb8-43cc-b03a-439d01a1d83e tempest-CreateVolumesFromSnapshotTest-1671640564 None] Created volume successfully. Jul 07 22:14:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ab32e9d9-388c-432c-92a1-95fcc6a37bb8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "cinder-086970e9-0242-4ffb-8122-bc1d0c2ffc00-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:14:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ab32e9d9-388c-432c-92a1-95fcc6a37bb8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-086970e9-0242-4ffb-8122-bc1d0c2ffc00-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:14:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ab32e9d9-388c-432c-92a1-95fcc6a37bb8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "cinder-quobyte-086970e9-0242-4ffb-8122-bc1d0c2ffc00" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:14:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ab32e9d9-388c-432c-92a1-95fcc6a37bb8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-quobyte-086970e9-0242-4ffb-8122-bc1d0c2ffc00" acquired by "delete_volume" :: waited 0.014s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:14:31 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[629367da-d287-4c69-9207-b767e17349e0]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:14:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ab32e9d9-388c-432c-92a1-95fcc6a37bb8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-086970e9-0242-4ffb-8122-bc1d0c2ffc00 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:31 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-086970e9-0242-4ffb-8122-bc1d0c2ffc00 Jul 07 22:14:31 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:31 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ab32e9d9-388c-432c-92a1-95fcc6a37bb8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-086970e9-0242-4ffb-8122-bc1d0c2ffc00" returned: 0 in 0.729s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ab32e9d9-388c-432c-92a1-95fcc6a37bb8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-086970e9-0242-4ffb-8122-bc1d0c2ffc00 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:31 devstack sudo[104738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-086970e9-0242-4ffb-8122-bc1d0c2ffc00 Jul 07 22:14:31 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:32 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ab32e9d9-388c-432c-92a1-95fcc6a37bb8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-086970e9-0242-4ffb-8122-bc1d0c2ffc00" returned: 0 in 0.639s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:32 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ab32e9d9-388c-432c-92a1-95fcc6a37bb8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-quobyte-086970e9-0242-4ffb-8122-bc1d0c2ffc00" released by "delete_volume" :: held 1.403s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:14:32 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-ab32e9d9-388c-432c-92a1-95fcc6a37bb8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Created reservations ['9bfd9b3b-e3d1-41e6-8aa1-e4122234a3ad', 'e4ad7c1d-92ef-4475-8b37-7952ba079837', '8494eb0a-7589-4a2e-bff5-ca6fec4681f7', 'd54085a6-bba3-41f1-b2f9-88aafef5fff8'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:14:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ab32e9d9-388c-432c-92a1-95fcc6a37bb8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ab32e9d9-388c-432c-92a1-95fcc6a37bb8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ab32e9d9-388c-432c-92a1-95fcc6a37bb8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:14:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ab32e9d9-388c-432c-92a1-95fcc6a37bb8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:14:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ab32e9d9-388c-432c-92a1-95fcc6a37bb8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ab32e9d9-388c-432c-92a1-95fcc6a37bb8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:32 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:14:32 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:33 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5b12d91a-0608-4a46-81d3-7c210acdbfc7 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "cinder-2d902b78-0a7f-497a-9518-be38b0762a7e-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:14:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ab32e9d9-388c-432c-92a1-95fcc6a37bb8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.672s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:33 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-ab32e9d9-388c-432c-92a1-95fcc6a37bb8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:14:33 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ab32e9d9-388c-432c-92a1-95fcc6a37bb8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Deleted volume successfully. Jul 07 22:14:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5b12d91a-0608-4a46-81d3-7c210acdbfc7 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-2d902b78-0a7f-497a-9518-be38b0762a7e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:14:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ab32e9d9-388c-432c-92a1-95fcc6a37bb8 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-086970e9-0242-4ffb-8122-bc1d0c2ffc00-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:14:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5b12d91a-0608-4a46-81d3-7c210acdbfc7 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "cinder-quobyte-2d902b78-0a7f-497a-9518-be38b0762a7e" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:14:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5b12d91a-0608-4a46-81d3-7c210acdbfc7 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-quobyte-2d902b78-0a7f-497a-9518-be38b0762a7e" acquired by "delete_volume" :: waited 0.013s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:14:33 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[09020b65-583c-4c8e-8ab1-b9dcc6827d14]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:14:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5b12d91a-0608-4a46-81d3-7c210acdbfc7 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d902b78-0a7f-497a-9518-be38b0762a7e {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:33 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d902b78-0a7f-497a-9518-be38b0762a7e Jul 07 22:14:33 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:34 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5b12d91a-0608-4a46-81d3-7c210acdbfc7 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d902b78-0a7f-497a-9518-be38b0762a7e" returned: 0 in 0.751s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5b12d91a-0608-4a46-81d3-7c210acdbfc7 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d902b78-0a7f-497a-9518-be38b0762a7e {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:34 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d902b78-0a7f-497a-9518-be38b0762a7e Jul 07 22:14:34 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:34 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5b12d91a-0608-4a46-81d3-7c210acdbfc7 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2d902b78-0a7f-497a-9518-be38b0762a7e" returned: 0 in 0.625s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5b12d91a-0608-4a46-81d3-7c210acdbfc7 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-quobyte-2d902b78-0a7f-497a-9518-be38b0762a7e" released by "delete_volume" :: held 1.412s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:14:34 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-5b12d91a-0608-4a46-81d3-7c210acdbfc7 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Created reservations ['719a6f70-a08f-4726-a3fe-283436848f22', 'ce0836f8-76d0-4757-9501-cf6e1da111e1', '9bd822df-27aa-4421-993b-361694463b5b', '7c947d24-f2d6-49dc-a09c-3b3931e8ada0'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:14:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5b12d91a-0608-4a46-81d3-7c210acdbfc7 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5b12d91a-0608-4a46-81d3-7c210acdbfc7 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5b12d91a-0608-4a46-81d3-7c210acdbfc7 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:14:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5b12d91a-0608-4a46-81d3-7c210acdbfc7 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:14:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5b12d91a-0608-4a46-81d3-7c210acdbfc7 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5b12d91a-0608-4a46-81d3-7c210acdbfc7 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:34 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:14:34 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:35 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4291857b-a5a5-4c8f-9e93-f6f9a1e9babb tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "cinder-30240ef6-0e68-481b-8817-f7ce1f116c46-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:14:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5b12d91a-0608-4a46-81d3-7c210acdbfc7 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.638s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:35 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-5b12d91a-0608-4a46-81d3-7c210acdbfc7 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:14:35 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-5b12d91a-0608-4a46-81d3-7c210acdbfc7 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Deleted volume successfully. Jul 07 22:14:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4291857b-a5a5-4c8f-9e93-f6f9a1e9babb tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-30240ef6-0e68-481b-8817-f7ce1f116c46-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:14:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5b12d91a-0608-4a46-81d3-7c210acdbfc7 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-2d902b78-0a7f-497a-9518-be38b0762a7e-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:14:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4291857b-a5a5-4c8f-9e93-f6f9a1e9babb tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "cinder-quobyte-30240ef6-0e68-481b-8817-f7ce1f116c46" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:14:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:14:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:14:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:14:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4291857b-a5a5-4c8f-9e93-f6f9a1e9babb tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-quobyte-30240ef6-0e68-481b-8817-f7ce1f116c46" acquired by "delete_volume" :: waited 0.032s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:14:35 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:14:35 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:35 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3139484e-3177-47b1-bfa2-7c402b2c3600]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:14:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4291857b-a5a5-4c8f-9e93-f6f9a1e9babb tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-30240ef6-0e68-481b-8817-f7ce1f116c46 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:35 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-30240ef6-0e68-481b-8817-f7ce1f116c46 Jul 07 22:14:35 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:36 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.632s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:14:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:14:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 28 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 22:14:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 22:14:36 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4291857b-a5a5-4c8f-9e93-f6f9a1e9babb tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-30240ef6-0e68-481b-8817-f7ce1f116c46" returned: 0 in 0.783s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4291857b-a5a5-4c8f-9e93-f6f9a1e9babb tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-30240ef6-0e68-481b-8817-f7ce1f116c46 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:36 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-30240ef6-0e68-481b-8817-f7ce1f116c46 Jul 07 22:14:36 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:37 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4291857b-a5a5-4c8f-9e93-f6f9a1e9babb tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-30240ef6-0e68-481b-8817-f7ce1f116c46" returned: 0 in 0.666s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4291857b-a5a5-4c8f-9e93-f6f9a1e9babb tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-quobyte-30240ef6-0e68-481b-8817-f7ce1f116c46" released by "delete_volume" :: held 1.487s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:14:37 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-4291857b-a5a5-4c8f-9e93-f6f9a1e9babb tempest-CreateVolumesFromSnapshotTest-1671640564 None] Created reservations ['8bc54784-bc0c-4101-a3f3-559c9cc34912', 'd714a4f7-415a-4fad-bf95-6e9a66e1b0ee', 'f819badd-4a7c-4438-9cae-b8e6f18057c9', 'cb5bc19a-795f-40c6-b831-9f138a132a3e'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:14:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4291857b-a5a5-4c8f-9e93-f6f9a1e9babb tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4291857b-a5a5-4c8f-9e93-f6f9a1e9babb tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4291857b-a5a5-4c8f-9e93-f6f9a1e9babb tempest-CreateVolumesFromSnapshotTest-1671640564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:14:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4291857b-a5a5-4c8f-9e93-f6f9a1e9babb tempest-CreateVolumesFromSnapshotTest-1671640564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:14:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4291857b-a5a5-4c8f-9e93-f6f9a1e9babb tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4291857b-a5a5-4c8f-9e93-f6f9a1e9babb tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:37 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:14:37 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4121b694-dbf6-4cd9-a2e9-981a13b25b75 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "cinder-8fd1ada4-116d-4a73-aafe-61a6e5b7f246-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:14:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4121b694-dbf6-4cd9-a2e9-981a13b25b75 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-8fd1ada4-116d-4a73-aafe-61a6e5b7f246-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:14:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4121b694-dbf6-4cd9-a2e9-981a13b25b75 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "cinder-quobyte-8fd1ada4-116d-4a73-aafe-61a6e5b7f246" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:14:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4121b694-dbf6-4cd9-a2e9-981a13b25b75 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-quobyte-8fd1ada4-116d-4a73-aafe-61a6e5b7f246" acquired by "delete_volume" :: waited 0.014s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:14:37 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4e751a-f7b3-48a9-9b24-0c72c3b73237]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:14:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4121b694-dbf6-4cd9-a2e9-981a13b25b75 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8fd1ada4-116d-4a73-aafe-61a6e5b7f246 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:37 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4291857b-a5a5-4c8f-9e93-f6f9a1e9babb tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.641s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:37 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-4291857b-a5a5-4c8f-9e93-f6f9a1e9babb tempest-CreateVolumesFromSnapshotTest-1671640564 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:14:37 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-4291857b-a5a5-4c8f-9e93-f6f9a1e9babb tempest-CreateVolumesFromSnapshotTest-1671640564 None] Deleted volume successfully. Jul 07 22:14:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4291857b-a5a5-4c8f-9e93-f6f9a1e9babb tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-30240ef6-0e68-481b-8817-f7ce1f116c46-delete_volume" released by "delete_volume" :: held 2.357s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:14:37 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8fd1ada4-116d-4a73-aafe-61a6e5b7f246 Jul 07 22:14:37 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:38 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4121b694-dbf6-4cd9-a2e9-981a13b25b75 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8fd1ada4-116d-4a73-aafe-61a6e5b7f246" returned: 0 in 0.739s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4121b694-dbf6-4cd9-a2e9-981a13b25b75 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8fd1ada4-116d-4a73-aafe-61a6e5b7f246 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:38 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8fd1ada4-116d-4a73-aafe-61a6e5b7f246 Jul 07 22:14:38 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:39 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4121b694-dbf6-4cd9-a2e9-981a13b25b75 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8fd1ada4-116d-4a73-aafe-61a6e5b7f246" returned: 0 in 0.618s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4121b694-dbf6-4cd9-a2e9-981a13b25b75 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-quobyte-8fd1ada4-116d-4a73-aafe-61a6e5b7f246" released by "delete_volume" :: held 1.400s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:14:39 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-4121b694-dbf6-4cd9-a2e9-981a13b25b75 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Created reservations ['3bf537fe-ed4a-4e72-b28a-7352dedc5df3', '2e0b662a-a09a-4bc4-9a1e-d4d1624c73ff', '4ec6eee4-26e8-4995-b912-df6b086a4a2e', 'f7d90f33-6a82-4354-99e5-404ba77d91ff'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:14:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4121b694-dbf6-4cd9-a2e9-981a13b25b75 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4121b694-dbf6-4cd9-a2e9-981a13b25b75 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:39 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4121b694-dbf6-4cd9-a2e9-981a13b25b75 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:14:39 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4121b694-dbf6-4cd9-a2e9-981a13b25b75 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:14:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4121b694-dbf6-4cd9-a2e9-981a13b25b75 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4121b694-dbf6-4cd9-a2e9-981a13b25b75 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:39 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:14:39 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:39 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4121b694-dbf6-4cd9-a2e9-981a13b25b75 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.636s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:39 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-4121b694-dbf6-4cd9-a2e9-981a13b25b75 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:14:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a34e25ec-9451-40d1-ade9-29e19c5abf9f tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "cinder-ab6f6dd7-5c4f-48eb-85d1-f947df3ee963-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:14:39 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-4121b694-dbf6-4cd9-a2e9-981a13b25b75 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Deleted volume successfully. Jul 07 22:14:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a34e25ec-9451-40d1-ade9-29e19c5abf9f tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-ab6f6dd7-5c4f-48eb-85d1-f947df3ee963-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:14:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4121b694-dbf6-4cd9-a2e9-981a13b25b75 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-8fd1ada4-116d-4a73-aafe-61a6e5b7f246-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:14:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a34e25ec-9451-40d1-ade9-29e19c5abf9f tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "cinder-quobyte-ab6f6dd7-5c4f-48eb-85d1-f947df3ee963" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:14:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a34e25ec-9451-40d1-ade9-29e19c5abf9f tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-quobyte-ab6f6dd7-5c4f-48eb-85d1-f947df3ee963" acquired by "delete_volume" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:14:40 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9839cb8f-ada6-4995-a0d0-0cabd48a7ccb]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:14:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a34e25ec-9451-40d1-ade9-29e19c5abf9f tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6f6dd7-5c4f-48eb-85d1-f947df3ee963 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:40 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6f6dd7-5c4f-48eb-85d1-f947df3ee963 Jul 07 22:14:40 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:40 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a34e25ec-9451-40d1-ade9-29e19c5abf9f tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6f6dd7-5c4f-48eb-85d1-f947df3ee963" returned: 0 in 0.771s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a34e25ec-9451-40d1-ade9-29e19c5abf9f tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6f6dd7-5c4f-48eb-85d1-f947df3ee963 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:40 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6f6dd7-5c4f-48eb-85d1-f947df3ee963 Jul 07 22:14:40 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:41 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a34e25ec-9451-40d1-ade9-29e19c5abf9f tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ab6f6dd7-5c4f-48eb-85d1-f947df3ee963" returned: 0 in 0.653s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:41 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a34e25ec-9451-40d1-ade9-29e19c5abf9f tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-quobyte-ab6f6dd7-5c4f-48eb-85d1-f947df3ee963" released by "delete_volume" :: held 1.461s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:14:41 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-a34e25ec-9451-40d1-ade9-29e19c5abf9f tempest-CreateVolumesFromSnapshotTest-1671640564 None] Created reservations ['411abb62-d624-4efe-b53c-d80e02acb853', 'fb430a7e-3d25-4fac-b02f-f2c94df9ed49', 'dce4c14c-0021-4b85-97bf-1376ad38a030', 'bcbc800d-2ae4-4262-9d39-401c0f1de808'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:14:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a34e25ec-9451-40d1-ade9-29e19c5abf9f tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a34e25ec-9451-40d1-ade9-29e19c5abf9f tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a34e25ec-9451-40d1-ade9-29e19c5abf9f tempest-CreateVolumesFromSnapshotTest-1671640564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:14:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a34e25ec-9451-40d1-ade9-29e19c5abf9f tempest-CreateVolumesFromSnapshotTest-1671640564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:14:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a34e25ec-9451-40d1-ade9-29e19c5abf9f tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a34e25ec-9451-40d1-ade9-29e19c5abf9f tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:41 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:14:41 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d5ad7973-cee5-49bc-9c14-18b55eb85158 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "cinder-4d4f3748-7c6f-4c75-8b79-471dfbcd6c82-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:14:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d5ad7973-cee5-49bc-9c14-18b55eb85158 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-4d4f3748-7c6f-4c75-8b79-471dfbcd6c82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:14:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d5ad7973-cee5-49bc-9c14-18b55eb85158 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "cinder-quobyte-34ed6e8e-3d37-428d-be03-38fcf35b0e22" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:14:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d5ad7973-cee5-49bc-9c14-18b55eb85158 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-quobyte-34ed6e8e-3d37-428d-be03-38fcf35b0e22" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:14:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d5ad7973-cee5-49bc-9c14-18b55eb85158 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "cinder-quobyte-4d4f3748-7c6f-4c75-8b79-471dfbcd6c82" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:14:42 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a34e25ec-9451-40d1-ade9-29e19c5abf9f tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.614s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:42 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-a34e25ec-9451-40d1-ade9-29e19c5abf9f tempest-CreateVolumesFromSnapshotTest-1671640564 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:14:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d5ad7973-cee5-49bc-9c14-18b55eb85158 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-quobyte-4d4f3748-7c6f-4c75-8b79-471dfbcd6c82" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:14:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-d5ad7973-cee5-49bc-9c14-18b55eb85158 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Deleting offline snapshot 4d4f3748-7c6f-4c75-8b79-471dfbcd6c82 of volume 34ed6e8e-3d37-428d-be03-38fcf35b0e22 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:14:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-d5ad7973-cee5-49bc-9c14-18b55eb85158 tempest-CreateVolumesFromSnapshotTest-1671640564 None] snapshot_file for this snap is: volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.4d4f3748-7c6f-4c75-8b79-471dfbcd6c82 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:14:42 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-a34e25ec-9451-40d1-ade9-29e19c5abf9f tempest-CreateVolumesFromSnapshotTest-1671640564 None] Deleted volume successfully. Jul 07 22:14:42 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6f8b9c-7299-4b28-8101-3b45dc79c6e9]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:14:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d5ad7973-cee5-49bc-9c14-18b55eb85158 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.4d4f3748-7c6f-4c75-8b79-471dfbcd6c82 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a34e25ec-9451-40d1-ade9-29e19c5abf9f tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-ab6f6dd7-5c4f-48eb-85d1-f947df3ee963-delete_volume" released by "delete_volume" :: held 2.307s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:14:42 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.4d4f3748-7c6f-4c75-8b79-471dfbcd6c82 Jul 07 22:14:42 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:43 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d5ad7973-cee5-49bc-9c14-18b55eb85158 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.4d4f3748-7c6f-4c75-8b79-471dfbcd6c82" returned: 0 in 0.720s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-d5ad7973-cee5-49bc-9c14-18b55eb85158 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:14:43 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cfccaa-d501-44e5-9830-f6558c3127ac]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:14:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d5ad7973-cee5-49bc-9c14-18b55eb85158 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:43 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22 Jul 07 22:14:43 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:43 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d5ad7973-cee5-49bc-9c14-18b55eb85158 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22" returned: 0 in 0.722s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d5ad7973-cee5-49bc-9c14-18b55eb85158 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.4d4f3748-7c6f-4c75-8b79-471dfbcd6c82 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:43 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.4d4f3748-7c6f-4c75-8b79-471dfbcd6c82 Jul 07 22:14:43 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:44 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d5ad7973-cee5-49bc-9c14-18b55eb85158 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.4d4f3748-7c6f-4c75-8b79-471dfbcd6c82" returned: 0 in 0.714s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d5ad7973-cee5-49bc-9c14-18b55eb85158 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.4d4f3748-7c6f-4c75-8b79-471dfbcd6c82 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:44 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.4d4f3748-7c6f-4c75-8b79-471dfbcd6c82 Jul 07 22:14:44 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:45 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d5ad7973-cee5-49bc-9c14-18b55eb85158 tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22.4d4f3748-7c6f-4c75-8b79-471dfbcd6c82" returned: 0 in 0.661s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:45 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d5ad7973-cee5-49bc-9c14-18b55eb85158 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-quobyte-4d4f3748-7c6f-4c75-8b79-471dfbcd6c82" released by "_delete_snapshot" :: held 2.921s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:14:45 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d5ad7973-cee5-49bc-9c14-18b55eb85158 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-quobyte-34ed6e8e-3d37-428d-be03-38fcf35b0e22" released by "delete_snapshot" :: held 2.950s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:14:45 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-d5ad7973-cee5-49bc-9c14-18b55eb85158 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Created reservations ['38009258-ff56-4f60-98a7-5bcf3a254247', 'ecd90bcb-9f00-46c8-bb09-8ad659d388e0', '2eb2cf45-6adc-4bb2-82a1-ec88a95b275e', 'ea0ff317-b2b0-40f7-bc3f-7e3aeba1a810'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:14:45 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d5ad7973-cee5-49bc-9c14-18b55eb85158 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Delete snapshot completed successfully. Jul 07 22:14:45 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d5ad7973-cee5-49bc-9c14-18b55eb85158 tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-4d4f3748-7c6f-4c75-8b79-471dfbcd6c82-delete_snapshot" released by "delete_snapshot" :: held 3.086s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:14:45 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b18c3ccf-b6f2-4af5-b845-7ede7d8c9a5a tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "cinder-34ed6e8e-3d37-428d-be03-38fcf35b0e22-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:14:45 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b18c3ccf-b6f2-4af5-b845-7ede7d8c9a5a tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-34ed6e8e-3d37-428d-be03-38fcf35b0e22-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:14:45 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b18c3ccf-b6f2-4af5-b845-7ede7d8c9a5a tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "cinder-quobyte-34ed6e8e-3d37-428d-be03-38fcf35b0e22" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:14:45 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b18c3ccf-b6f2-4af5-b845-7ede7d8c9a5a tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-quobyte-34ed6e8e-3d37-428d-be03-38fcf35b0e22" acquired by "delete_volume" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:14:45 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf94bb1-f819-449a-85a7-0320db856eb4]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:14:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b18c3ccf-b6f2-4af5-b845-7ede7d8c9a5a tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:45 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22 Jul 07 22:14:45 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:46 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b18c3ccf-b6f2-4af5-b845-7ede7d8c9a5a tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22" returned: 0 in 0.732s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b18c3ccf-b6f2-4af5-b845-7ede7d8c9a5a tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:46 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22 Jul 07 22:14:46 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:46 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b18c3ccf-b6f2-4af5-b845-7ede7d8c9a5a tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-34ed6e8e-3d37-428d-be03-38fcf35b0e22" returned: 0 in 0.621s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:46 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b18c3ccf-b6f2-4af5-b845-7ede7d8c9a5a tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-quobyte-34ed6e8e-3d37-428d-be03-38fcf35b0e22" released by "delete_volume" :: held 1.407s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:14:46 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-b18c3ccf-b6f2-4af5-b845-7ede7d8c9a5a tempest-CreateVolumesFromSnapshotTest-1671640564 None] Created reservations ['2661b89a-b5de-449c-b7d6-cf37a36d0ee3', '73abeef5-6514-4161-b54f-17067439f7e2', 'e0e9d2f6-4e66-4343-a585-2b5a5fb1d443', 'e110d603-0948-4d3e-8568-9e95527634ee'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:14:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b18c3ccf-b6f2-4af5-b845-7ede7d8c9a5a tempest-CreateVolumesFromSnapshotTest-1671640564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b18c3ccf-b6f2-4af5-b845-7ede7d8c9a5a tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:46 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b18c3ccf-b6f2-4af5-b845-7ede7d8c9a5a tempest-CreateVolumesFromSnapshotTest-1671640564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:14:46 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b18c3ccf-b6f2-4af5-b845-7ede7d8c9a5a tempest-CreateVolumesFromSnapshotTest-1671640564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:14:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b18c3ccf-b6f2-4af5-b845-7ede7d8c9a5a tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b18c3ccf-b6f2-4af5-b845-7ede7d8c9a5a tempest-CreateVolumesFromSnapshotTest-1671640564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:47 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:14:47 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:47 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b18c3ccf-b6f2-4af5-b845-7ede7d8c9a5a tempest-CreateVolumesFromSnapshotTest-1671640564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.641s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:47 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-b18c3ccf-b6f2-4af5-b845-7ede7d8c9a5a tempest-CreateVolumesFromSnapshotTest-1671640564 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:14:47 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-b18c3ccf-b6f2-4af5-b845-7ede7d8c9a5a tempest-CreateVolumesFromSnapshotTest-1671640564 None] Deleted volume successfully. Jul 07 22:14:47 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=70,cinder:UPDATE=84,cinder:INSERT=20,cinder:DELETE=8 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:14:47 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b18c3ccf-b6f2-4af5-b845-7ede7d8c9a5a tempest-CreateVolumesFromSnapshotTest-1671640564 None] Lock "cinder-34ed6e8e-3d37-428d-be03-38fcf35b0e22-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:14:56 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:UPDATE=87,cinder:SELECT=58,cinder:INSERT=30,cinder:DELETE=7 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Flow 'volume_create_manager' (badcf2a2-25cb-488a-bbbf-65d65d6c9a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1d58ec-ba5f-46ad-bd96-04cd5b40b28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1d58ec-ba5f-46ad-bd96-04cd5b40b28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1502522366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a6021e8-bc33-48f8-98a7-3303c40f6c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5142f03fd9514e6090e575ce5b27745d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:14:59Z,use_quota=True,user_id='650e3a1ddccc40f3b0226528760d33d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f6f9f7-9b5f-4ee0-b75a-4b4c58d9758c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f6f9f7-9b5f-4ee0-b75a-4b4c58d9758c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435d22c7-72df-4569-9155-9964230f873f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435d22c7-72df-4569-9155-9964230f873f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a6021e8-bc33-48f8-98a7-3303c40f6c82', 'volume_name': 'volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbd1d4d-3e1e-4c0c-9db7-d9fdd73b0ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbd1d4d-3e1e-4c0c-9db7-d9fdd73b0ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c7252b-fc88-4d73-bb2c-0cf59aceed71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:58 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Volume 7a6021e8-bc33-48f8-98a7-3303c40f6c82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82', 'volume_size': 1} Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1502522366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a6021e8-bc33-48f8-98a7-3303c40f6c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5142f03fd9514e6090e575ce5b27745d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:14:59Z,use_quota=True,user_id='650e3a1ddccc40f3b0226528760d33d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Creating volume 7a6021e8-bc33-48f8-98a7-3303c40f6c82 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:14:58 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:14:58 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 1073741824 Jul 07 22:14:58 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:14:58 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Flow 'volume_create_manager' (1ae0bea8-6055-4e7d-b7c6-8b4ff7af1364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58939460-f48d-43fb-bbd7-ed724e5ce506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58939460-f48d-43fb-bbd7-ed724e5ce506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1310348195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce40a627-a4e1-4d14-b16e-bed5b7f2f301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f97a96b5684d87a6792af4772bfb35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:14:59Z,use_quota=True,user_id='9eb9f051d4584a98abb585c9cc134c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f959b6-ad42-461d-8faf-d80133cdf741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f959b6-ad42-461d-8faf-d80133cdf741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3155028-a1c2-4a20-87d1-f8246d3e673a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3155028-a1c2-4a20-87d1-f8246d3e673a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce40a627-a4e1-4d14-b16e-bed5b7f2f301', 'volume_name': 'volume-ce40a627-a4e1-4d14-b16e-bed5b7f2f301', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17546c8-a6fe-4ee1-beb0-2f2450e5ce00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17546c8-a6fe-4ee1-beb0-2f2450e5ce00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae066d1-932f-46ed-866e-a23165500c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:59 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Volume ce40a627-a4e1-4d14-b16e-bed5b7f2f301: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce40a627-a4e1-4d14-b16e-bed5b7f2f301', 'volume_size': 1} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Flow 'volume_create_manager' (b97d78ea-7b85-4aa0-b39c-869b8ca56866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6367a3-e0be-4be2-830e-5de0b1599c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6367a3-e0be-4be2-830e-5de0b1599c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1665735815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c6bf833-6d03-4b07-a3d2-b67ff873a058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88de714d4c334221bcc72b65a9596351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:14:59Z,use_quota=True,user_id='007a0b1bf19e4fffa8f2997c8e80813c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896acd3b-7268-4b95-8ca9-fadf92b73f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896acd3b-7268-4b95-8ca9-fadf92b73f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd00eda7-0f3f-46bc-aba9-01bc40e4d01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd00eda7-0f3f-46bc-aba9-01bc40e4d01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c6bf833-6d03-4b07-a3d2-b67ff873a058', 'volume_name': 'volume-7c6bf833-6d03-4b07-a3d2-b67ff873a058', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca7fd5ad-f027-481e-820f-d086085977bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca7fd5ad-f027-481e-820f-d086085977bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f3b472-854d-490e-87f5-765a6ba30634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:59 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Volume 7c6bf833-6d03-4b07-a3d2-b67ff873a058: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c6bf833-6d03-4b07-a3d2-b67ff873a058', 'volume_size': 1} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Flow 'volume_create_manager' (fc768c10-a5ef-4c12-a82c-bc189388db9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (630435fc-03a1-4cdd-b8f2-e1ffdf40e68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:59 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 1073741824" returned: 0 in 1.014s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (630435fc-03a1-4cdd-b8f2-e1ffdf40e68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-195115651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aee8ccf-fd7c-4a26-8bac-d91196fab327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88de714d4c334221bcc72b65a9596351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:00Z,use_quota=True,user_id='007a0b1bf19e4fffa8f2997c8e80813c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acee9d5d-9e03-4b1a-8e6c-3c596610bc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acee9d5d-9e03-4b1a-8e6c-3c596610bc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace56805-e711-4a77-8b1a-1990e778d8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace56805-e711-4a77-8b1a-1990e778d8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aee8ccf-fd7c-4a26-8bac-d91196fab327', 'volume_name': 'volume-2aee8ccf-fd7c-4a26-8bac-d91196fab327', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c25c799-877a-47fb-ad67-2d76e5ac16df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c25c799-877a-47fb-ad67-2d76e5ac16df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a4c3e9-9903-469a-8b60-dfeb3bf50efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:14:59 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Volume 2aee8ccf-fd7c-4a26-8bac-d91196fab327: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aee8ccf-fd7c-4a26-8bac-d91196fab327', 'volume_size': 1} Jul 07 22:14:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:00 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 Jul 07 22:15:00 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Flow 'volume_create_manager' (10725a6c-7bc6-4bfd-80c4-2a92d0ae6b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e271668d-7674-4a10-9a3f-f4c7f399574e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e271668d-7674-4a10-9a3f-f4c7f399574e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1786808631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37468720-380d-4bf5-94bd-7551f8fdd0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88de714d4c334221bcc72b65a9596351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:00Z,use_quota=True,user_id='007a0b1bf19e4fffa8f2997c8e80813c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce325849-8f01-4ecc-bbf5-1aae835f59db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce325849-8f01-4ecc-bbf5-1aae835f59db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec37e3d7-7a45-449d-abab-757a4a864b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec37e3d7-7a45-449d-abab-757a4a864b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37468720-380d-4bf5-94bd-7551f8fdd0c4', 'volume_name': 'volume-37468720-380d-4bf5-94bd-7551f8fdd0c4', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d622d5-f904-401a-930c-fde261bb2d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d622d5-f904-401a-930c-fde261bb2d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220c5517-f456-4037-9a5c-17dbac8a13a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:00 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Volume 37468720-380d-4bf5-94bd-7551f8fdd0c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37468720-380d-4bf5-94bd-7551f8fdd0c4', 'volume_size': 1} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Flow 'volume_create_manager' (1b191d2e-d886-4d49-88b3-a49a46381ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5acac2-b606-496e-8349-221e63b45293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5acac2-b606-496e-8349-221e63b45293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-545144250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88de714d4c334221bcc72b65a9596351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:01Z,use_quota=True,user_id='007a0b1bf19e4fffa8f2997c8e80813c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8902224a-013d-40cb-9c63-ebafe5741524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8902224a-013d-40cb-9c63-ebafe5741524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6e3330-f802-4269-a8aa-e122df5fa6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6e3330-f802-4269-a8aa-e122df5fa6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19', 'volume_name': 'volume-94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa20c246-3c15-4a49-bb46-d5224f16b8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa20c246-3c15-4a49-bb46-d5224f16b8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd30bad-78a3-4fe4-ae60-53f4865cbb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:00 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Volume 94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19', 'volume_size': 1} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:00 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82" returned: 0 in 0.851s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.785s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1310348195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce40a627-a4e1-4d14-b16e-bed5b7f2f301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f97a96b5684d87a6792af4772bfb35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:14:59Z,use_quota=True,user_id='9eb9f051d4584a98abb585c9cc134c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Creating volume ce40a627-a4e1-4d14-b16e-bed5b7f2f301 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:15:00 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce40a627-a4e1-4d14-b16e-bed5b7f2f301 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:00 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce40a627-a4e1-4d14-b16e-bed5b7f2f301 1073741824 Jul 07 22:15:00 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c7252b-fc88-4d73-bb2c-0cf59aceed71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:00 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (842ebe73-033a-4f96-b691-b5a870705304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:00 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Volume volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 (7a6021e8-bc33-48f8-98a7-3303c40f6c82): created successfully Jul 07 22:15:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (842ebe73-033a-4f96-b691-b5a870705304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Flow 'volume_create_manager' (badcf2a2-25cb-488a-bbbf-65d65d6c9a2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:01 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-0f40db2d-5dac-46dd-b83a-632b3668496a tempest-VolumeDependencyTests-1752792086 None] Created volume successfully. Jul 07 22:15:01 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:15:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Flow 'volume_create_manager' (f30125b8-10a1-415d-a319-6fea95824eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6154ec-8aa4-4fc5-bc6f-9ead35248c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6154ec-8aa4-4fc5-bc6f-9ead35248c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1892230140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e59a29d4-89b4-478a-b002-efb43e3c9c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88de714d4c334221bcc72b65a9596351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:01Z,use_quota=True,user_id='007a0b1bf19e4fffa8f2997c8e80813c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5015b0-f78f-4e0b-baf5-50de403a9391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5015b0-f78f-4e0b-baf5-50de403a9391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f5b1be-788d-4c04-ac60-9d5eb3c6ab0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f5b1be-788d-4c04-ac60-9d5eb3c6ab0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e59a29d4-89b4-478a-b002-efb43e3c9c2b', 'volume_name': 'volume-e59a29d4-89b4-478a-b002-efb43e3c9c2b', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab2bf7d-4abb-48f0-ab40-e2b2c4dee813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab2bf7d-4abb-48f0-ab40-e2b2c4dee813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:01 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715ba72f-8b29-4a65-aaa0-b7a76656663c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:01 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Volume e59a29d4-89b4-478a-b002-efb43e3c9c2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e59a29d4-89b4-478a-b002-efb43e3c9c2b', 'volume_size': 1} Jul 07 22:15:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:01 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce40a627-a4e1-4d14-b16e-bed5b7f2f301 1073741824" returned: 0 in 0.851s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce40a627-a4e1-4d14-b16e-bed5b7f2f301 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:01 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce40a627-a4e1-4d14-b16e-bed5b7f2f301 Jul 07 22:15:01 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-69ac2630-5172-4f63-b4fa-f8beca358bfd tempest-VolumeDependencyTests-1752792086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:02 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce40a627-a4e1-4d14-b16e-bed5b7f2f301" returned: 0 in 0.669s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.798s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1665735815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c6bf833-6d03-4b07-a3d2-b67ff873a058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88de714d4c334221bcc72b65a9596351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:14:59Z,use_quota=True,user_id='007a0b1bf19e4fffa8f2997c8e80813c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Creating volume 7c6bf833-6d03-4b07-a3d2-b67ff873a058 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:15:02 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c6bf833-6d03-4b07-a3d2-b67ff873a058 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae066d1-932f-46ed-866e-a23165500c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce40a627-a4e1-4d14-b16e-bed5b7f2f301', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:02 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c6bf833-6d03-4b07-a3d2-b67ff873a058 1073741824 Jul 07 22:15:02 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f7ec8b-5639-4c2a-8442-562f2a17aaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:02 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Volume volume-ce40a627-a4e1-4d14-b16e-bed5b7f2f301 (ce40a627-a4e1-4d14-b16e-bed5b7f2f301): created successfully Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f7ec8b-5639-4c2a-8442-562f2a17aaef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Flow 'volume_create_manager' (1ae0bea8-6055-4e7d-b7c6-8b4ff7af1364) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:02 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-30cc70e1-a9eb-4534-9136-84e9e70ebf32 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Created volume successfully. Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Flow 'volume_create_manager' (a877e9d2-f731-4e10-8b21-9540606bc38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5493cb44-3d93-48fd-94c5-5c97e19365a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5493cb44-3d93-48fd-94c5-5c97e19365a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8769dc6-533e-4983-b53f-4a1a9a097414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='635b070ae0554982b5ec9e370fbd19f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:03Z,use_quota=True,user_id='85a3da11f408406ea340215ddb967105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50391126-d674-4260-863b-e34bd1687aa4),volume_type_id=50391126-d674-4260-863b-e34bd1687aa4)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f6b3bc-ba02-44fc-9f27-6c64dc005ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f6b3bc-ba02-44fc-9f27-6c64dc005ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2777f2b5-2764-48ed-a886-7689e5996624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.image.glance [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Creating Keystone auth plugin from conf {{(pid=87586) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2777f2b5-2764-48ed-a886-7689e5996624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd8769dc6-533e-4983-b53f-4a1a9a097414', 'volume_name': 'volume-d8769dc6-533e-4983-b53f-4a1a9a097414', 'volume_size': 1, 'image_id': 'e18452f6-5529-4914-b932-cac16af12687', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e18452f6-5529-4914-b932-cac16af12687', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b684a67e4000624719281daa5ad56ada', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '635b070ae0554982b5ec9e370fbd19f1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed0c19f636d82335cf3ebbe2d45943586e5651b612c1ab2df186796c1a653580d348ad7eb604f93f8c853ec7fd742aa02ee66f5b49eee6e4802476075a96821d', 'id': 'e18452f6-5529-4914-b932-cac16af12687', 'created_at': datetime.datetime(2026, 7, 7, 20, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 15, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e18452f6-5529-4914-b932-cac16af12687/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52979602-685a-464c-ab13-aa3a3c680a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52979602-685a-464c-ab13-aa3a3c680a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb32691-8b6c-4144-8945-9dccf82f194d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:02 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Volume d8769dc6-533e-4983-b53f-4a1a9a097414: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d8769dc6-533e-4983-b53f-4a1a9a097414', 'volume_size': 1, 'image_id': 'e18452f6-5529-4914-b932-cac16af12687', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e18452f6-5529-4914-b932-cac16af12687', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b684a67e4000624719281daa5ad56ada', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '635b070ae0554982b5ec9e370fbd19f1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed0c19f636d82335cf3ebbe2d45943586e5651b612c1ab2df186796c1a653580d348ad7eb604f93f8c853ec7fd742aa02ee66f5b49eee6e4802476075a96821d', 'id': 'e18452f6-5529-4914-b932-cac16af12687', 'created_at': datetime.datetime(2026, 7, 7, 20, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 15, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e18452f6-5529-4914-b932-cac16af12687/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Trying to clone d8769dc6-533e-4983-b53f-4a1a9a097414 from image e18452f6-5529-4914-b932-cac16af12687 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e18452f6-5529-4914-b932-cac16af12687', 'metadata': {}}]). {{(pid=87586) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:15:02 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:15:02 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Image download 0.00 MB at 0.00 MB/s Jul 07 22:15:03 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fe1548-1ac6-4f2f-9f86-a73696405b7a]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:03 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD Jul 07 22:15:03 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:03 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c6bf833-6d03-4b07-a3d2-b67ff873a058 1073741824" returned: 0 in 0.957s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c6bf833-6d03-4b07-a3d2-b67ff873a058 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:03 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c6bf833-6d03-4b07-a3d2-b67ff873a058 Jul 07 22:15:03 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:03 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:15:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Flow 'volume_create_manager' (82e18788-1694-4fdd-aa2a-cce1bc86ed51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1e7ca4-564e-4e02-91e5-930646191744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1e7ca4-564e-4e02-91e5-930646191744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-24775891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6058172a-7e50-494e-aa3f-51c2ec7c1041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f97a96b5684d87a6792af4772bfb35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:04Z,use_quota=True,user_id='9eb9f051d4584a98abb585c9cc134c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14d7b0c-7b80-4ba1-9da2-7f28208234ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14d7b0c-7b80-4ba1-9da2-7f28208234ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5cfc2f3-1818-4f86-95b8-9561c6897bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5cfc2f3-1818-4f86-95b8-9561c6897bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6058172a-7e50-494e-aa3f-51c2ec7c1041', 'volume_name': 'volume-6058172a-7e50-494e-aa3f-51c2ec7c1041', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c07e66-6d3a-4370-9b95-54842e9af544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c07e66-6d3a-4370-9b95-54842e9af544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5ee80c-2dc6-489b-be3c-62eeb72aed02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:03 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Volume 6058172a-7e50-494e-aa3f-51c2ec7c1041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6058172a-7e50-494e-aa3f-51c2ec7c1041', 'volume_size': 1} Jul 07 22:15:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:03 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD" returned: 0 in 0.818s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:03 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD Jul 07 22:15:03 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Flow 'volume_create_manager' (866c3ff6-1fe9-4289-ac4b-eefabbd72c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da1a57c-8e85-4fac-84e9-96eb489e7304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da1a57c-8e85-4fac-84e9-96eb489e7304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1420747136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c81f60f0-9a6f-4174-afb4-a3355e6ad591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f97a96b5684d87a6792af4772bfb35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:04Z,use_quota=True,user_id='9eb9f051d4584a98abb585c9cc134c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28843a5d-91ea-4125-9ecd-afd68fabed05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28843a5d-91ea-4125-9ecd-afd68fabed05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007d7b98-c8af-4c9f-8f03-45d8a53472f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007d7b98-c8af-4c9f-8f03-45d8a53472f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c81f60f0-9a6f-4174-afb4-a3355e6ad591', 'volume_name': 'volume-c81f60f0-9a6f-4174-afb4-a3355e6ad591', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77603fff-7aec-49f1-99cf-35b3f01146e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77603fff-7aec-49f1-99cf-35b3f01146e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97bb7a6-952b-457a-ae49-191928ca27a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:04 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Volume c81f60f0-9a6f-4174-afb4-a3355e6ad591: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c81f60f0-9a6f-4174-afb4-a3355e6ad591', 'volume_size': 1} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:04 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c6bf833-6d03-4b07-a3d2-b67ff873a058" returned: 0 in 0.851s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.332s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-195115651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aee8ccf-fd7c-4a26-8bac-d91196fab327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88de714d4c334221bcc72b65a9596351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:00Z,use_quota=True,user_id='007a0b1bf19e4fffa8f2997c8e80813c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Creating volume 2aee8ccf-fd7c-4a26-8bac-d91196fab327 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:15:04 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2aee8ccf-fd7c-4a26-8bac-d91196fab327 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:04 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2aee8ccf-fd7c-4a26-8bac-d91196fab327 1073741824 Jul 07 22:15:04 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f3b472-854d-490e-87f5-765a6ba30634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c6bf833-6d03-4b07-a3d2-b67ff873a058', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5a4e4c-6595-4104-9a36-16c8a08fe615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:04 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Volume volume-7c6bf833-6d03-4b07-a3d2-b67ff873a058 (7c6bf833-6d03-4b07-a3d2-b67ff873a058): created successfully Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5a4e4c-6595-4104-9a36-16c8a08fe615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Flow 'volume_create_manager' (b97d78ea-7b85-4aa0-b39c-869b8ca56866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:04 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-303183f4-534e-4bca-9d63-278626f6b59c tempest-CreateVolumesFromImageTest-967968289 None] Created volume successfully. Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Flow 'volume_create_manager' (dfc1b418-15a1-4737-91a3-2454925eb0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221dbe8c-edfb-45e3-8952-d9728570b069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221dbe8c-edfb-45e3-8952-d9728570b069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1419863228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e26ec4-567f-444e-a03d-07d376df2080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f97a96b5684d87a6792af4772bfb35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:05Z,use_quota=True,user_id='9eb9f051d4584a98abb585c9cc134c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff3eba4-16c3-4826-8b42-6922b1f6420b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff3eba4-16c3-4826-8b42-6922b1f6420b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4a27ef-298e-4f41-8716-7ae2974add8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4a27ef-298e-4f41-8716-7ae2974add8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68e26ec4-567f-444e-a03d-07d376df2080', 'volume_name': 'volume-68e26ec4-567f-444e-a03d-07d376df2080', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d0e8dc-db88-4d79-958d-9942a2776b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d0e8dc-db88-4d79-958d-9942a2776b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3b5483-a750-4972-b228-28f9abdb3b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:04 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Volume 68e26ec4-567f-444e-a03d-07d376df2080: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68e26ec4-567f-444e-a03d-07d376df2080', 'volume_size': 1} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:04 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD" returned: 1 in 0.944s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Temporary image e18452f6-5529-4914-b932-cac16af12687 is fetched for user 85a3da11f408406ea340215ddb967105. {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[667c875e-9836-460e-ae03-5a6a42f544d5]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:05 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD Jul 07 22:15:05 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Flow 'volume_create_manager' (e1842fe2-1398-4a76-911d-11fb06d3215f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eef8352-9fb1-4613-9cf1-c58d9e652b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eef8352-9fb1-4613-9cf1-c58d9e652b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-761630542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1658815-2a3d-40ed-8c4a-eb7328a5de83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f97a96b5684d87a6792af4772bfb35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:05Z,use_quota=True,user_id='9eb9f051d4584a98abb585c9cc134c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4094f3-51c0-4868-95b8-27f45757eb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4094f3-51c0-4868-95b8-27f45757eb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469ac75f-4a9d-4305-a428-8a40aaeaa766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469ac75f-4a9d-4305-a428-8a40aaeaa766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1658815-2a3d-40ed-8c4a-eb7328a5de83', 'volume_name': 'volume-d1658815-2a3d-40ed-8c4a-eb7328a5de83', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50feca71-5bbb-4844-96b3-f990008016e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50feca71-5bbb-4844-96b3-f990008016e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5baa8da1-d5f5-4b1b-9eb9-57cc0d357c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:05 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Volume d1658815-2a3d-40ed-8c4a-eb7328a5de83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1658815-2a3d-40ed-8c4a-eb7328a5de83', 'volume_size': 1} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:05 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2aee8ccf-fd7c-4a26-8bac-d91196fab327 1073741824" returned: 0 in 0.989s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2aee8ccf-fd7c-4a26-8bac-d91196fab327 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:05 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2aee8ccf-fd7c-4a26-8bac-d91196fab327 Jul 07 22:15:05 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Flow 'volume_create_manager' (c8833aa9-cf41-4c97-a1f1-74e8f689933d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b5d31b-9fd7-443b-875a-d84a2ce18937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b5d31b-9fd7-443b-875a-d84a2ce18937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1525254505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb013b07-adb8-4a08-a342-2ab15be532eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f97a96b5684d87a6792af4772bfb35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:05Z,use_quota=True,user_id='9eb9f051d4584a98abb585c9cc134c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee8ef802-8f36-408f-8928-23c36740b6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee8ef802-8f36-408f-8928-23c36740b6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180f4e37-6368-47d2-9873-2e222b1ac4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180f4e37-6368-47d2-9873-2e222b1ac4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb013b07-adb8-4a08-a342-2ab15be532eb', 'volume_name': 'volume-bb013b07-adb8-4a08-a342-2ab15be532eb', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a11081b-9095-4116-acb3-b6de11f18de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a11081b-9095-4116-acb3-b6de11f18de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f332d98-0333-47a3-9666-647d6cf4039b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:05 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Volume bb013b07-adb8-4a08-a342-2ab15be532eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb013b07-adb8-4a08-a342-2ab15be532eb', 'volume_size': 1} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:05 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD" returned: 0 in 0.817s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:05 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD Jul 07 22:15:05 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:06 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2aee8ccf-fd7c-4a26-8bac-d91196fab327" returned: 0 in 0.696s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:15:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.520s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1786808631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37468720-380d-4bf5-94bd-7551f8fdd0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88de714d4c334221bcc72b65a9596351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:00Z,use_quota=True,user_id='007a0b1bf19e4fffa8f2997c8e80813c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:15:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Creating volume 37468720-380d-4bf5-94bd-7551f8fdd0c4 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:15:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:15:06 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:15:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37468720-380d-4bf5-94bd-7551f8fdd0c4 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a4c3e9-9903-469a-8b60-dfeb3bf50efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aee8ccf-fd7c-4a26-8bac-d91196fab327', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:06 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37468720-380d-4bf5-94bd-7551f8fdd0c4 1073741824 Jul 07 22:15:06 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad1c459-be65-425e-97ef-b3b29d82ccdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:06 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Volume volume-2aee8ccf-fd7c-4a26-8bac-d91196fab327 (2aee8ccf-fd7c-4a26-8bac-d91196fab327): created successfully Jul 07 22:15:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad1c459-be65-425e-97ef-b3b29d82ccdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:06 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Flow 'volume_create_manager' (fc768c10-a5ef-4c12-a82c-bc189388db9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:06 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-dd075b7c-4b28-437a-b889-89905a30c31f tempest-CreateVolumesFromImageTest-967968289 None] Created volume successfully. Jul 07 22:15:06 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD" returned: 1 in 0.716s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:15:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:06 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37468720-380d-4bf5-94bd-7551f8fdd0c4 1073741824" returned: 0 in 0.817s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37468720-380d-4bf5-94bd-7551f8fdd0c4 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:06 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37468720-380d-4bf5-94bd-7551f8fdd0c4 Jul 07 22:15:06 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:07 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37468720-380d-4bf5-94bd-7551f8fdd0c4" returned: 0 in 0.652s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:15:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.777s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-545144250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88de714d4c334221bcc72b65a9596351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:01Z,use_quota=True,user_id='007a0b1bf19e4fffa8f2997c8e80813c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:15:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Creating volume 94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:15:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:15:07 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:15:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:07 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19 1073741824 Jul 07 22:15:07 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220c5517-f456-4037-9a5c-17dbac8a13a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37468720-380d-4bf5-94bd-7551f8fdd0c4', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bda15d7-4feb-4b30-9f90-228bc5b706fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:07 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Volume volume-37468720-380d-4bf5-94bd-7551f8fdd0c4 (37468720-380d-4bf5-94bd-7551f8fdd0c4): created successfully Jul 07 22:15:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bda15d7-4feb-4b30-9f90-228bc5b706fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Flow 'volume_create_manager' (10725a6c-7bc6-4bfd-80c4-2a92d0ae6b1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:07 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-5c22f9e6-3c26-4225-bd2b-f1c75a13d11f tempest-CreateVolumesFromImageTest-967968289 None] Created volume successfully. Jul 07 22:15:08 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19 1073741824" returned: 0 in 0.855s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:08 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19 Jul 07 22:15:08 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:09 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19" returned: 0 in 0.623s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:15:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.883s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1892230140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e59a29d4-89b4-478a-b002-efb43e3c9c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88de714d4c334221bcc72b65a9596351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:01Z,use_quota=True,user_id='007a0b1bf19e4fffa8f2997c8e80813c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:15:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Creating volume e59a29d4-89b4-478a-b002-efb43e3c9c2b {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:15:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:15:09 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:15:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e59a29d4-89b4-478a-b002-efb43e3c9c2b 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd30bad-78a3-4fe4-ae60-53f4865cbb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:09 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e59a29d4-89b4-478a-b002-efb43e3c9c2b 1073741824 Jul 07 22:15:09 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94698ec5-01e9-4c30-8ee8-73381e58f97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:09 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Volume volume-94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19 (94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19): created successfully Jul 07 22:15:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94698ec5-01e9-4c30-8ee8-73381e58f97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Flow 'volume_create_manager' (1b191d2e-d886-4d49-88b3-a49a46381ab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:09 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-40642078-fdc0-4360-a696-58def8e1e51b tempest-CreateVolumesFromImageTest-967968289 None] Created volume successfully. Jul 07 22:15:09 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e59a29d4-89b4-478a-b002-efb43e3c9c2b 1073741824" returned: 0 in 0.840s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e59a29d4-89b4-478a-b002-efb43e3c9c2b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:10 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e59a29d4-89b4-478a-b002-efb43e3c9c2b Jul 07 22:15:10 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:10 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e59a29d4-89b4-478a-b002-efb43e3c9c2b" returned: 0 in 0.612s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:15:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-69ac2630-5172-4f63-b4fa-f8beca358bfd tempest-VolumeDependencyTests-1752792086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.343s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-69ac2630-5172-4f63-b4fa-f8beca358bfd tempest-VolumeDependencyTests-1752792086 None] Creating offline snapshot cac498d7-a04e-42b6-bfac-cd03f8491b23 of volume 7a6021e8-bc33-48f8-98a7-3303c40f6c82 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:15:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715ba72f-8b29-4a65-aaa0-b7a76656663c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e59a29d4-89b4-478a-b002-efb43e3c9c2b', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3baa78e-7561-4c69-b94c-fa915a9385b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:10 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8543e0-3ca4-4588-938b-a6885cca7633]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69ac2630-5172-4f63-b4fa-f8beca358bfd tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:10 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Volume volume-e59a29d4-89b4-478a-b002-efb43e3c9c2b (e59a29d4-89b4-478a-b002-efb43e3c9c2b): created successfully Jul 07 22:15:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3baa78e-7561-4c69-b94c-fa915a9385b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Flow 'volume_create_manager' (f30125b8-10a1-415d-a319-6fea95824eef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:10 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-5d254ea8-9f4f-4003-b611-d2fe26f115ae tempest-CreateVolumesFromImageTest-967968289 None] Created volume successfully. Jul 07 22:15:10 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 Jul 07 22:15:10 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5bd19f09-27b7-4b1b-9164-de98e097a0d7 tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "cinder-e59a29d4-89b4-478a-b002-efb43e3c9c2b-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5bd19f09-27b7-4b1b-9164-de98e097a0d7 tempest-CreateVolumesFromImageTest-967968289 None] Lock "cinder-e59a29d4-89b4-478a-b002-efb43e3c9c2b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5bd19f09-27b7-4b1b-9164-de98e097a0d7 tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "cinder-quobyte-e59a29d4-89b4-478a-b002-efb43e3c9c2b" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5bd19f09-27b7-4b1b-9164-de98e097a0d7 tempest-CreateVolumesFromImageTest-967968289 None] Lock "cinder-quobyte-e59a29d4-89b4-478a-b002-efb43e3c9c2b" acquired by "delete_volume" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:11 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9f317d-63e6-4c5c-a57c-9facec076d0a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5bd19f09-27b7-4b1b-9164-de98e097a0d7 tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e59a29d4-89b4-478a-b002-efb43e3c9c2b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:11 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e59a29d4-89b4-478a-b002-efb43e3c9c2b Jul 07 22:15:11 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:11 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69ac2630-5172-4f63-b4fa-f8beca358bfd tempest-VolumeDependencyTests-1752792086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82" returned: 0 in 0.771s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69ac2630-5172-4f63-b4fa-f8beca358bfd tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:11 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23 1G Jul 07 22:15:11 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:12 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5bd19f09-27b7-4b1b-9164-de98e097a0d7 tempest-CreateVolumesFromImageTest-967968289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e59a29d4-89b4-478a-b002-efb43e3c9c2b" returned: 0 in 0.801s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5bd19f09-27b7-4b1b-9164-de98e097a0d7 tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e59a29d4-89b4-478a-b002-efb43e3c9c2b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:12 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e59a29d4-89b4-478a-b002-efb43e3c9c2b Jul 07 22:15:12 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:12 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69ac2630-5172-4f63-b4fa-f8beca358bfd tempest-VolumeDependencyTests-1752792086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23 1G" returned: 0 in 0.795s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69ac2630-5172-4f63-b4fa-f8beca358bfd tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:12 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23 Jul 07 22:15:12 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:12 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5bd19f09-27b7-4b1b-9164-de98e097a0d7 tempest-CreateVolumesFromImageTest-967968289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e59a29d4-89b4-478a-b002-efb43e3c9c2b" returned: 0 in 0.659s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:12 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5bd19f09-27b7-4b1b-9164-de98e097a0d7 tempest-CreateVolumesFromImageTest-967968289 None] Lock "cinder-quobyte-e59a29d4-89b4-478a-b002-efb43e3c9c2b" released by "delete_volume" :: held 1.505s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:12 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-5bd19f09-27b7-4b1b-9164-de98e097a0d7 tempest-CreateVolumesFromImageTest-967968289 None] Created reservations ['7c0ec450-9950-4bdc-80a6-9d5dd8e0c436', 'ef5e63c2-c60c-4125-9a66-4c4bd1e40d02', '70fb9de7-321f-400b-adb0-4343d214538f', 'e8d75cc5-977a-49e0-89e8-e2888d13a1dc'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:15:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5bd19f09-27b7-4b1b-9164-de98e097a0d7 tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5bd19f09-27b7-4b1b-9164-de98e097a0d7 tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:12 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5bd19f09-27b7-4b1b-9164-de98e097a0d7 tempest-CreateVolumesFromImageTest-967968289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:12 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5bd19f09-27b7-4b1b-9164-de98e097a0d7 tempest-CreateVolumesFromImageTest-967968289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5bd19f09-27b7-4b1b-9164-de98e097a0d7 tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5bd19f09-27b7-4b1b-9164-de98e097a0d7 tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:12 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:15:12 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:12 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69ac2630-5172-4f63-b4fa-f8beca358bfd tempest-VolumeDependencyTests-1752792086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23" returned: 0 in 0.751s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:12 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-69ac2630-5172-4f63-b4fa-f8beca358bfd tempest-VolumeDependencyTests-1752792086 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23 is being set with open permissions: ugo+rw Jul 07 22:15:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69ac2630-5172-4f63-b4fa-f8beca358bfd tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:13 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23 Jul 07 22:15:13 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-eb6aa0df-fed8-4bba-b607-6e2079aacbfa tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "cinder-94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-eb6aa0df-fed8-4bba-b607-6e2079aacbfa tempest-CreateVolumesFromImageTest-967968289 None] Lock "cinder-94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-eb6aa0df-fed8-4bba-b607-6e2079aacbfa tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "cinder-quobyte-94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-eb6aa0df-fed8-4bba-b607-6e2079aacbfa tempest-CreateVolumesFromImageTest-967968289 None] Lock "cinder-quobyte-94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19" acquired by "delete_volume" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:13 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[150d5ae4-8621-4579-977e-02804e2af751]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb6aa0df-fed8-4bba-b607-6e2079aacbfa tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:13 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5bd19f09-27b7-4b1b-9164-de98e097a0d7 tempest-CreateVolumesFromImageTest-967968289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.674s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:13 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-5bd19f09-27b7-4b1b-9164-de98e097a0d7 tempest-CreateVolumesFromImageTest-967968289 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:15:13 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-5bd19f09-27b7-4b1b-9164-de98e097a0d7 tempest-CreateVolumesFromImageTest-967968289 None] Deleted volume successfully. Jul 07 22:15:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5bd19f09-27b7-4b1b-9164-de98e097a0d7 tempest-CreateVolumesFromImageTest-967968289 None] Lock "cinder-e59a29d4-89b4-478a-b002-efb43e3c9c2b-delete_volume" released by "delete_volume" :: held 2.459s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:13 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19 Jul 07 22:15:13 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:13 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69ac2630-5172-4f63-b4fa-f8beca358bfd tempest-VolumeDependencyTests-1752792086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23" returned: 0 in 0.700s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69ac2630-5172-4f63-b4fa-f8beca358bfd tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:13 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.info Jul 07 22:15:13 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:14 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb6aa0df-fed8-4bba-b607-6e2079aacbfa tempest-CreateVolumesFromImageTest-967968289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19" returned: 0 in 0.800s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb6aa0df-fed8-4bba-b607-6e2079aacbfa tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:14 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19 Jul 07 22:15:14 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:14 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69ac2630-5172-4f63-b4fa-f8beca358bfd tempest-VolumeDependencyTests-1752792086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.info" returned: 0 in 0.657s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:14 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-69ac2630-5172-4f63-b4fa-f8beca358bfd tempest-VolumeDependencyTests-1752792086 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.info is being set with open permissions: ugo+rw Jul 07 22:15:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69ac2630-5172-4f63-b4fa-f8beca358bfd tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:14 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.info Jul 07 22:15:14 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:15 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69ac2630-5172-4f63-b4fa-f8beca358bfd tempest-VolumeDependencyTests-1752792086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.info" returned: 0 in 0.630s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-69ac2630-5172-4f63-b4fa-f8beca358bfd tempest-VolumeDependencyTests-1752792086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.413s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.261s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-24775891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6058172a-7e50-494e-aa3f-51c2ec7c1041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f97a96b5684d87a6792af4772bfb35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:04Z,use_quota=True,user_id='9eb9f051d4584a98abb585c9cc134c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Creating volume 6058172a-7e50-494e-aa3f-51c2ec7c1041 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:15:15 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6058172a-7e50-494e-aa3f-51c2ec7c1041 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:15 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb6aa0df-fed8-4bba-b607-6e2079aacbfa tempest-CreateVolumesFromImageTest-967968289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19" returned: 0 in 0.729s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:15 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6058172a-7e50-494e-aa3f-51c2ec7c1041 1073741824 Jul 07 22:15:15 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-eb6aa0df-fed8-4bba-b607-6e2079aacbfa tempest-CreateVolumesFromImageTest-967968289 None] Lock "cinder-quobyte-94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19" released by "delete_volume" :: held 1.584s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:15 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-69ac2630-5172-4f63-b4fa-f8beca358bfd tempest-VolumeDependencyTests-1752792086 None] Create snapshot completed successfully Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-eb6aa0df-fed8-4bba-b607-6e2079aacbfa tempest-CreateVolumesFromImageTest-967968289 None] Created reservations ['b8866814-a56e-4c09-8463-8e5ff418492a', '4931184b-564a-4324-8d16-1ea0effeb152', '5ccfe059-23aa-439a-a73d-c740c364a53d', '1e4c0ca1-dc7c-4e5e-ac48-ab9577675482'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-eb6aa0df-fed8-4bba-b607-6e2079aacbfa tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-eb6aa0df-fed8-4bba-b607-6e2079aacbfa tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-eb6aa0df-fed8-4bba-b607-6e2079aacbfa tempest-CreateVolumesFromImageTest-967968289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-eb6aa0df-fed8-4bba-b607-6e2079aacbfa tempest-CreateVolumesFromImageTest-967968289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-eb6aa0df-fed8-4bba-b607-6e2079aacbfa tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb6aa0df-fed8-4bba-b607-6e2079aacbfa tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:15 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:15:15 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7c9bdfd4-c2e1-4e13-8064-c6d5597f0f96 tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "cinder-37468720-380d-4bf5-94bd-7551f8fdd0c4-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7c9bdfd4-c2e1-4e13-8064-c6d5597f0f96 tempest-CreateVolumesFromImageTest-967968289 None] Lock "cinder-37468720-380d-4bf5-94bd-7551f8fdd0c4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7c9bdfd4-c2e1-4e13-8064-c6d5597f0f96 tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "cinder-quobyte-37468720-380d-4bf5-94bd-7551f8fdd0c4" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7c9bdfd4-c2e1-4e13-8064-c6d5597f0f96 tempest-CreateVolumesFromImageTest-967968289 None] Lock "cinder-quobyte-37468720-380d-4bf5-94bd-7551f8fdd0c4" acquired by "delete_volume" :: waited 0.014s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6255df-8928-4734-9bef-6c2b6da4262c]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7c9bdfd4-c2e1-4e13-8064-c6d5597f0f96 tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37468720-380d-4bf5-94bd-7551f8fdd0c4 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:15 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-eb6aa0df-fed8-4bba-b607-6e2079aacbfa tempest-CreateVolumesFromImageTest-967968289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.644s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-eb6aa0df-fed8-4bba-b607-6e2079aacbfa tempest-CreateVolumesFromImageTest-967968289 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:15:15 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-eb6aa0df-fed8-4bba-b607-6e2079aacbfa tempest-CreateVolumesFromImageTest-967968289 None] Deleted volume successfully. Jul 07 22:15:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-eb6aa0df-fed8-4bba-b607-6e2079aacbfa tempest-CreateVolumesFromImageTest-967968289 None] Lock "cinder-94fcbf75-7e1c-48c0-b29e-32c3aa5d3f19-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:15 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37468720-380d-4bf5-94bd-7551f8fdd0c4 Jul 07 22:15:15 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:16 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6058172a-7e50-494e-aa3f-51c2ec7c1041 1073741824" returned: 0 in 1.021s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6058172a-7e50-494e-aa3f-51c2ec7c1041 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:16 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6058172a-7e50-494e-aa3f-51c2ec7c1041 Jul 07 22:15:16 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Flow 'volume_create_manager' (125f7e36-5a39-4d7d-9639-9719435d248f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d113323-b743-4959-8d25-64f4b8eceeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d113323-b743-4959-8d25-64f4b8eceeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1548790658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f3e7d6f-d92c-4859-98d3-a5578c25b5a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5142f03fd9514e6090e575ce5b27745d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cac498d7-a04e-42b6-bfac-cd03f8491b23,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:16Z,use_quota=True,user_id='650e3a1ddccc40f3b0226528760d33d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81e377ce-85c8-4d24-8627-9be5d46e470c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81e377ce-85c8-4d24-8627-9be5d46e470c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb50241e-cf46-49f4-882e-1261bc40eef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb50241e-cf46-49f4-882e-1261bc40eef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4f3e7d6f-d92c-4859-98d3-a5578c25b5a3', 'volume_name': 'volume-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3', 'volume_size': 1, 'snapshot_id': 'cac498d7-a04e-42b6-bfac-cd03f8491b23'}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9523dcc0-2c77-4492-b762-cfa064886c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9523dcc0-2c77-4492-b762-cfa064886c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103e78d9-10d1-49a7-83b6-d4b6e4e907b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:16 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Volume 4f3e7d6f-d92c-4859-98d3-a5578c25b5a3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3', 'volume_size': 1, 'snapshot_id': 'cac498d7-a04e-42b6-bfac-cd03f8491b23'} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:16 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7c9bdfd4-c2e1-4e13-8064-c6d5597f0f96 tempest-CreateVolumesFromImageTest-967968289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37468720-380d-4bf5-94bd-7551f8fdd0c4" returned: 0 in 0.822s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7c9bdfd4-c2e1-4e13-8064-c6d5597f0f96 tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37468720-380d-4bf5-94bd-7551f8fdd0c4 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:16 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37468720-380d-4bf5-94bd-7551f8fdd0c4 Jul 07 22:15:16 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:16 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6058172a-7e50-494e-aa3f-51c2ec7c1041" returned: 0 in 0.674s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.600s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1420747136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c81f60f0-9a6f-4174-afb4-a3355e6ad591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f97a96b5684d87a6792af4772bfb35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:04Z,use_quota=True,user_id='9eb9f051d4584a98abb585c9cc134c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Creating volume c81f60f0-9a6f-4174-afb4-a3355e6ad591 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:15:16 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c81f60f0-9a6f-4174-afb4-a3355e6ad591 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5ee80c-2dc6-489b-be3c-62eeb72aed02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6058172a-7e50-494e-aa3f-51c2ec7c1041', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:16 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c81f60f0-9a6f-4174-afb4-a3355e6ad591 1073741824 Jul 07 22:15:16 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c14b95ab-b36f-43ee-9de5-7ca54f5ea930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:16 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Volume volume-6058172a-7e50-494e-aa3f-51c2ec7c1041 (6058172a-7e50-494e-aa3f-51c2ec7c1041): created successfully Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c14b95ab-b36f-43ee-9de5-7ca54f5ea930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Flow 'volume_create_manager' (82e18788-1694-4fdd-aa2a-cce1bc86ed51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:16 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-161f90e9-eee2-4265-bca6-8fb59045fbb1 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Created volume successfully. Jul 07 22:15:17 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7c9bdfd4-c2e1-4e13-8064-c6d5597f0f96 tempest-CreateVolumesFromImageTest-967968289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37468720-380d-4bf5-94bd-7551f8fdd0c4" returned: 0 in 0.647s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:17 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7c9bdfd4-c2e1-4e13-8064-c6d5597f0f96 tempest-CreateVolumesFromImageTest-967968289 None] Lock "cinder-quobyte-37468720-380d-4bf5-94bd-7551f8fdd0c4" released by "delete_volume" :: held 1.509s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:17 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-7c9bdfd4-c2e1-4e13-8064-c6d5597f0f96 tempest-CreateVolumesFromImageTest-967968289 None] Created reservations ['ab70d2b6-ec7e-400c-bd5d-25aa25f2d818', 'ac30fdea-7614-4ee2-b16a-1c0888c04819', '8cdd72b1-7582-45df-b8a5-32cc78d7dbf3', '0dae73a4-c77f-45f5-b7bd-728ef0220b21'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:15:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7c9bdfd4-c2e1-4e13-8064-c6d5597f0f96 tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7c9bdfd4-c2e1-4e13-8064-c6d5597f0f96 tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:17 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7c9bdfd4-c2e1-4e13-8064-c6d5597f0f96 tempest-CreateVolumesFromImageTest-967968289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:17 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7c9bdfd4-c2e1-4e13-8064-c6d5597f0f96 tempest-CreateVolumesFromImageTest-967968289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7c9bdfd4-c2e1-4e13-8064-c6d5597f0f96 tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7c9bdfd4-c2e1-4e13-8064-c6d5597f0f96 tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:17 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:15:17 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:17 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c81f60f0-9a6f-4174-afb4-a3355e6ad591 1073741824" returned: 0 in 0.847s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c81f60f0-9a6f-4174-afb4-a3355e6ad591 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:17 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c81f60f0-9a6f-4174-afb4-a3355e6ad591 Jul 07 22:15:17 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:17 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-29821217-2960-44d9-b013-5154d1709242 tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "cinder-2aee8ccf-fd7c-4a26-8bac-d91196fab327-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:17 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-29821217-2960-44d9-b013-5154d1709242 tempest-CreateVolumesFromImageTest-967968289 None] Lock "cinder-2aee8ccf-fd7c-4a26-8bac-d91196fab327-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-29821217-2960-44d9-b013-5154d1709242 tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "cinder-quobyte-2aee8ccf-fd7c-4a26-8bac-d91196fab327" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-29821217-2960-44d9-b013-5154d1709242 tempest-CreateVolumesFromImageTest-967968289 None] Lock "cinder-quobyte-2aee8ccf-fd7c-4a26-8bac-d91196fab327" acquired by "delete_volume" :: waited 0.025s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[56391842-0c6c-463f-a0b4-c2a42982fc0c]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-29821217-2960-44d9-b013-5154d1709242 tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2aee8ccf-fd7c-4a26-8bac-d91196fab327 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:18 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7c9bdfd4-c2e1-4e13-8064-c6d5597f0f96 tempest-CreateVolumesFromImageTest-967968289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.686s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-7c9bdfd4-c2e1-4e13-8064-c6d5597f0f96 tempest-CreateVolumesFromImageTest-967968289 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:15:18 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-7c9bdfd4-c2e1-4e13-8064-c6d5597f0f96 tempest-CreateVolumesFromImageTest-967968289 None] Deleted volume successfully. Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7c9bdfd4-c2e1-4e13-8064-c6d5597f0f96 tempest-CreateVolumesFromImageTest-967968289 None] Lock "cinder-37468720-380d-4bf5-94bd-7551f8fdd0c4-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:18 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2aee8ccf-fd7c-4a26-8bac-d91196fab327 Jul 07 22:15:18 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:18 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c81f60f0-9a6f-4174-afb4-a3355e6ad591" returned: 0 in 0.665s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.574s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1419863228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e26ec4-567f-444e-a03d-07d376df2080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f97a96b5684d87a6792af4772bfb35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:05Z,use_quota=True,user_id='9eb9f051d4584a98abb585c9cc134c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Creating volume 68e26ec4-567f-444e-a03d-07d376df2080 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:15:18 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68e26ec4-567f-444e-a03d-07d376df2080 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97bb7a6-952b-457a-ae49-191928ca27a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c81f60f0-9a6f-4174-afb4-a3355e6ad591', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:18 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68e26ec4-567f-444e-a03d-07d376df2080 1073741824 Jul 07 22:15:18 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (018992df-3100-4c6c-839a-518adf260dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:18 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Volume volume-c81f60f0-9a6f-4174-afb4-a3355e6ad591 (c81f60f0-9a6f-4174-afb4-a3355e6ad591): created successfully Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (018992df-3100-4c6c-839a-518adf260dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Flow 'volume_create_manager' (866c3ff6-1fe9-4289-ac4b-eefabbd72c4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:18 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-a1f335be-0f95-4e96-9ae5-4378d20f0d4d tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Created volume successfully. Jul 07 22:15:18 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-29821217-2960-44d9-b013-5154d1709242 tempest-CreateVolumesFromImageTest-967968289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2aee8ccf-fd7c-4a26-8bac-d91196fab327" returned: 0 in 0.801s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-29821217-2960-44d9-b013-5154d1709242 tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2aee8ccf-fd7c-4a26-8bac-d91196fab327 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:18 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2aee8ccf-fd7c-4a26-8bac-d91196fab327 Jul 07 22:15:18 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:19 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68e26ec4-567f-444e-a03d-07d376df2080 1073741824" returned: 0 in 0.904s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68e26ec4-567f-444e-a03d-07d376df2080 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:19 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68e26ec4-567f-444e-a03d-07d376df2080 Jul 07 22:15:19 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:19 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-29821217-2960-44d9-b013-5154d1709242 tempest-CreateVolumesFromImageTest-967968289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-2aee8ccf-fd7c-4a26-8bac-d91196fab327" returned: 0 in 0.692s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-29821217-2960-44d9-b013-5154d1709242 tempest-CreateVolumesFromImageTest-967968289 None] Lock "cinder-quobyte-2aee8ccf-fd7c-4a26-8bac-d91196fab327" released by "delete_volume" :: held 1.539s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:19 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-29821217-2960-44d9-b013-5154d1709242 tempest-CreateVolumesFromImageTest-967968289 None] Created reservations ['491c4968-c4e0-4169-a110-aa1018c6b3e8', '49c8130a-3ec3-41a7-a72d-63242543738c', '0205f678-4f74-4d9f-b3ec-54143e5418c2', '67efc153-44f0-4ffd-b44c-7a404bb75904'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:15:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-29821217-2960-44d9-b013-5154d1709242 tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-29821217-2960-44d9-b013-5154d1709242 tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-29821217-2960-44d9-b013-5154d1709242 tempest-CreateVolumesFromImageTest-967968289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-29821217-2960-44d9-b013-5154d1709242 tempest-CreateVolumesFromImageTest-967968289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-29821217-2960-44d9-b013-5154d1709242 tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-29821217-2960-44d9-b013-5154d1709242 tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:19 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:15:19 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:19 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68e26ec4-567f-444e-a03d-07d376df2080" returned: 0 in 0.670s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:15:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.824s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-761630542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1658815-2a3d-40ed-8c4a-eb7328a5de83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f97a96b5684d87a6792af4772bfb35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:05Z,use_quota=True,user_id='9eb9f051d4584a98abb585c9cc134c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:15:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Creating volume d1658815-2a3d-40ed-8c4a-eb7328a5de83 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:15:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:15:20 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:15:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d1658815-2a3d-40ed-8c4a-eb7328a5de83 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:20 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d1658815-2a3d-40ed-8c4a-eb7328a5de83 1073741824 Jul 07 22:15:20 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:20 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3b5483-a750-4972-b228-28f9abdb3b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68e26ec4-567f-444e-a03d-07d376df2080', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:20 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cac1a68-a3c7-4616-8119-1e0e2fcf7290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:20 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Volume volume-68e26ec4-567f-444e-a03d-07d376df2080 (68e26ec4-567f-444e-a03d-07d376df2080): created successfully Jul 07 22:15:20 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cac1a68-a3c7-4616-8119-1e0e2fcf7290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:20 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Flow 'volume_create_manager' (dfc1b418-15a1-4737-91a3-2454925eb0e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:20 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-255289b4-819e-414e-9dcc-b01cdf41ea94 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Created volume successfully. Jul 07 22:15:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6c19422e-18e5-4983-8ad2-2fa0c826f936 tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "cinder-7c6bf833-6d03-4b07-a3d2-b67ff873a058-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6c19422e-18e5-4983-8ad2-2fa0c826f936 tempest-CreateVolumesFromImageTest-967968289 None] Lock "cinder-7c6bf833-6d03-4b07-a3d2-b67ff873a058-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6c19422e-18e5-4983-8ad2-2fa0c826f936 tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "cinder-quobyte-7c6bf833-6d03-4b07-a3d2-b67ff873a058" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6c19422e-18e5-4983-8ad2-2fa0c826f936 tempest-CreateVolumesFromImageTest-967968289 None] Lock "cinder-quobyte-7c6bf833-6d03-4b07-a3d2-b67ff873a058" acquired by "delete_volume" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:20 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[51469215-c51c-4538-a6d0-f4abae9170b7]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6c19422e-18e5-4983-8ad2-2fa0c826f936 tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c6bf833-6d03-4b07-a3d2-b67ff873a058 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:20 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-29821217-2960-44d9-b013-5154d1709242 tempest-CreateVolumesFromImageTest-967968289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.718s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:20 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-29821217-2960-44d9-b013-5154d1709242 tempest-CreateVolumesFromImageTest-967968289 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:15:20 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-29821217-2960-44d9-b013-5154d1709242 tempest-CreateVolumesFromImageTest-967968289 None] Deleted volume successfully. Jul 07 22:15:20 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c6bf833-6d03-4b07-a3d2-b67ff873a058 Jul 07 22:15:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-29821217-2960-44d9-b013-5154d1709242 tempest-CreateVolumesFromImageTest-967968289 None] Lock "cinder-2aee8ccf-fd7c-4a26-8bac-d91196fab327-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:20 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:20 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d1658815-2a3d-40ed-8c4a-eb7328a5de83 1073741824" returned: 0 in 0.871s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d1658815-2a3d-40ed-8c4a-eb7328a5de83 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:20 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d1658815-2a3d-40ed-8c4a-eb7328a5de83 Jul 07 22:15:20 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:21 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6c19422e-18e5-4983-8ad2-2fa0c826f936 tempest-CreateVolumesFromImageTest-967968289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c6bf833-6d03-4b07-a3d2-b67ff873a058" returned: 0 in 0.787s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6c19422e-18e5-4983-8ad2-2fa0c826f936 tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c6bf833-6d03-4b07-a3d2-b67ff873a058 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:21 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c6bf833-6d03-4b07-a3d2-b67ff873a058 Jul 07 22:15:21 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:21 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d1658815-2a3d-40ed-8c4a-eb7328a5de83" returned: 0 in 0.662s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.967s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1525254505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb013b07-adb8-4a08-a342-2ab15be532eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f97a96b5684d87a6792af4772bfb35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:05Z,use_quota=True,user_id='9eb9f051d4584a98abb585c9cc134c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Creating volume bb013b07-adb8-4a08-a342-2ab15be532eb {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:15:21 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bb013b07-adb8-4a08-a342-2ab15be532eb 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5baa8da1-d5f5-4b1b-9eb9-57cc0d357c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1658815-2a3d-40ed-8c4a-eb7328a5de83', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:21 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bb013b07-adb8-4a08-a342-2ab15be532eb 1073741824 Jul 07 22:15:21 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20216c31-5600-4318-912a-d25b346d834d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:21 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Volume volume-d1658815-2a3d-40ed-8c4a-eb7328a5de83 (d1658815-2a3d-40ed-8c4a-eb7328a5de83): created successfully Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20216c31-5600-4318-912a-d25b346d834d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Flow 'volume_create_manager' (e1842fe2-1398-4a76-911d-11fb06d3215f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:21 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-dea366fe-4b45-4a35-ac9d-904283f3ce10 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Created volume successfully. Jul 07 22:15:21 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6c19422e-18e5-4983-8ad2-2fa0c826f936 tempest-CreateVolumesFromImageTest-967968289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7c6bf833-6d03-4b07-a3d2-b67ff873a058" returned: 0 in 0.656s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6c19422e-18e5-4983-8ad2-2fa0c826f936 tempest-CreateVolumesFromImageTest-967968289 None] Lock "cinder-quobyte-7c6bf833-6d03-4b07-a3d2-b67ff873a058" released by "delete_volume" :: held 1.500s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-6c19422e-18e5-4983-8ad2-2fa0c826f936 tempest-CreateVolumesFromImageTest-967968289 None] Created reservations ['96f335c7-80cb-48ce-ba30-f0f3332a52cc', 'ecc6654c-acf0-46f2-9273-e22083dd69c2', '8aba2047-b85c-4ff5-9af6-8e469a7581ea', '3ef2508d-7072-4e50-8fe8-c21e90eba2f5'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6c19422e-18e5-4983-8ad2-2fa0c826f936 tempest-CreateVolumesFromImageTest-967968289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6c19422e-18e5-4983-8ad2-2fa0c826f936 tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6c19422e-18e5-4983-8ad2-2fa0c826f936 tempest-CreateVolumesFromImageTest-967968289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6c19422e-18e5-4983-8ad2-2fa0c826f936 tempest-CreateVolumesFromImageTest-967968289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6c19422e-18e5-4983-8ad2-2fa0c826f936 tempest-CreateVolumesFromImageTest-967968289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6c19422e-18e5-4983-8ad2-2fa0c826f936 tempest-CreateVolumesFromImageTest-967968289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:21 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:15:21 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:22 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bb013b07-adb8-4a08-a342-2ab15be532eb 1073741824" returned: 0 in 0.980s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:22 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6c19422e-18e5-4983-8ad2-2fa0c826f936 tempest-CreateVolumesFromImageTest-967968289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.708s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:22 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-6c19422e-18e5-4983-8ad2-2fa0c826f936 tempest-CreateVolumesFromImageTest-967968289 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:15:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bb013b07-adb8-4a08-a342-2ab15be532eb {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:22 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6c19422e-18e5-4983-8ad2-2fa0c826f936 tempest-CreateVolumesFromImageTest-967968289 None] Deleted volume successfully. Jul 07 22:15:22 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bb013b07-adb8-4a08-a342-2ab15be532eb Jul 07 22:15:22 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6c19422e-18e5-4983-8ad2-2fa0c826f936 tempest-CreateVolumesFromImageTest-967968289 None] Lock "cinder-7c6bf833-6d03-4b07-a3d2-b67ff873a058-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:23 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bb013b07-adb8-4a08-a342-2ab15be532eb" returned: 0 in 0.703s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:15:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.912s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8769dc6-533e-4983-b53f-4a1a9a097414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='635b070ae0554982b5ec9e370fbd19f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:03Z,use_quota=True,user_id='85a3da11f408406ea340215ddb967105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50391126-d674-4260-863b-e34bd1687aa4),volume_type_id=50391126-d674-4260-863b-e34bd1687aa4)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:15:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Creating volume d8769dc6-533e-4983-b53f-4a1a9a097414 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:15:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:15:23 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:15:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f332d98-0333-47a3-9666-647d6cf4039b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb013b07-adb8-4a08-a342-2ab15be532eb', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da40af1-3eb0-44f4-b16e-77b24e30003d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:23 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414 1073741824 Jul 07 22:15:23 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:23 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Volume volume-bb013b07-adb8-4a08-a342-2ab15be532eb (bb013b07-adb8-4a08-a342-2ab15be532eb): created successfully Jul 07 22:15:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da40af1-3eb0-44f4-b16e-77b24e30003d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Flow 'volume_create_manager' (c8833aa9-cf41-4c97-a1f1-74e8f689933d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:23 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-8e915e3a-66f3-46db-bbe9-f830970749ba tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Created volume successfully. Jul 07 22:15:23 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d1f13175-d93e-4f97-9b3d-ebdf70b9fe90 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "cinder-bb013b07-adb8-4a08-a342-2ab15be532eb-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:23 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d1f13175-d93e-4f97-9b3d-ebdf70b9fe90 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-bb013b07-adb8-4a08-a342-2ab15be532eb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d1f13175-d93e-4f97-9b3d-ebdf70b9fe90 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "cinder-quobyte-bb013b07-adb8-4a08-a342-2ab15be532eb" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:24 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d1f13175-d93e-4f97-9b3d-ebdf70b9fe90 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-quobyte-bb013b07-adb8-4a08-a342-2ab15be532eb" acquired by "delete_volume" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:24 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8786b07b-66be-47a6-af79-031f414f31ea]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d1f13175-d93e-4f97-9b3d-ebdf70b9fe90 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bb013b07-adb8-4a08-a342-2ab15be532eb {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:24 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bb013b07-adb8-4a08-a342-2ab15be532eb Jul 07 22:15:24 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:24 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414 1073741824" returned: 0 in 1.031s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:24 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414 Jul 07 22:15:24 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:24 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d1f13175-d93e-4f97-9b3d-ebdf70b9fe90 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bb013b07-adb8-4a08-a342-2ab15be532eb" returned: 0 in 0.832s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d1f13175-d93e-4f97-9b3d-ebdf70b9fe90 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bb013b07-adb8-4a08-a342-2ab15be532eb {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:24 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bb013b07-adb8-4a08-a342-2ab15be532eb Jul 07 22:15:24 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:25 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414" returned: 0 in 0.713s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.633s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Acquiring lock "cinder-quobyte-cac498d7-a04e-42b6-bfac-cd03f8491b23-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3" by "_create_volume_from_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Lock "cinder-quobyte-cac498d7-a04e-42b6-bfac-cd03f8491b23-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Creating volume 4f3e7d6f-d92c-4859-98d3-a5578c25b5a3 from snapshot cac498d7-a04e-42b6-bfac-cd03f8491b23 {{(pid=87586) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Acquiring lock "cinder-quobyte-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3" by "_copy_volume_from_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Attempting download of e18452f6-5529-4914-b932-cac16af12687 ((None, [{'url': 'file:///opt/stack/data/glance/images/e18452f6-5529-4914-b932-cac16af12687', 'metadata': {}}])) to volume d8769dc6-533e-4983-b53f-4a1a9a097414. {{(pid=87586) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Lock "cinder-quobyte-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] snapshot: cac498d7-a04e-42b6-bfac-cd03f8491b23, volume: 4f3e7d6f-d92c-4859-98d3-a5578c25b5a3, {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e810f69e-f919-4001-8bc1-7ffd07fd02ca]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd68f3e7-bd39-4548-9650-89c43e86a0d0]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e18452f6-5529-4914-b932-cac16af12687_c0aclghp {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:25 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23 Jul 07 22:15:25 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:25 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e18452f6-5529-4914-b932-cac16af12687_c0aclghp Jul 07 22:15:25 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:25 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d1f13175-d93e-4f97-9b3d-ebdf70b9fe90 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-bb013b07-adb8-4a08-a342-2ab15be532eb" returned: 0 in 0.747s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d1f13175-d93e-4f97-9b3d-ebdf70b9fe90 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-quobyte-bb013b07-adb8-4a08-a342-2ab15be532eb" released by "delete_volume" :: held 1.629s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-d1f13175-d93e-4f97-9b3d-ebdf70b9fe90 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Created reservations ['6c113436-ca38-4707-ba3c-5d647905e09d', 'b2553ed1-7207-4546-adb1-86093789d063', 'e530f040-799c-45e9-a294-973d55954e8b', 'd4095b11-ca67-4ead-82c7-aeb7100be193'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Flow 'volume_create_manager' (ec86c2d4-defa-4c2b-900f-eda278757dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b91615-ce36-4232-add9-820bcdcc47d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b91615-ce36-4232-add9-820bcdcc47d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-57327501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e44818ea-83ad-4e7f-a312-dcd0f8e6576b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484acbf1ac4044348d8bd288d3754141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:26Z,use_quota=True,user_id='1726058cd1bb40c5a62b34317c8abc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8544f455-c704-4914-a398-afbf4d3f6168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8544f455-c704-4914-a398-afbf4d3f6168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de46b29b-d415-40f2-8989-7e0d158cc41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de46b29b-d415-40f2-8989-7e0d158cc41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e44818ea-83ad-4e7f-a312-dcd0f8e6576b', 'volume_name': 'volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea58408-1a54-423c-b57f-10eadc8013c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea58408-1a54-423c-b57f-10eadc8013c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481836fc-238c-44e7-901f-e0f27db0debc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:25 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Volume e44818ea-83ad-4e7f-a312-dcd0f8e6576b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b', 'volume_size': 1} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d1f13175-d93e-4f97-9b3d-ebdf70b9fe90 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d1f13175-d93e-4f97-9b3d-ebdf70b9fe90 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d1f13175-d93e-4f97-9b3d-ebdf70b9fe90 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d1f13175-d93e-4f97-9b3d-ebdf70b9fe90 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d1f13175-d93e-4f97-9b3d-ebdf70b9fe90 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d1f13175-d93e-4f97-9b3d-ebdf70b9fe90 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:25 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:15:25 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:26 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23" returned: 0 in 0.882s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:26 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:15:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:15:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Creating direct copy from snapshot {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:15:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e18452f6-5529-4914-b932-cac16af12687_c0aclghp" returned: 0 in 0.875s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e18452f6-5529-4914-b932-cac16af12687_c0aclghp {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:26 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cd1a6e-0d7c-4496-8746-c66aa3e87051]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:26 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7771ae1a-d185-4d1c-85bd-33f33459dd8e tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "cinder-d1658815-2a3d-40ed-8c4a-eb7328a5de83-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:26 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7771ae1a-d185-4d1c-85bd-33f33459dd8e tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-d1658815-2a3d-40ed-8c4a-eb7328a5de83-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:26 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e18452f6-5529-4914-b932-cac16af12687_c0aclghp Jul 07 22:15:26 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:26 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7771ae1a-d185-4d1c-85bd-33f33459dd8e tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "cinder-quobyte-d1658815-2a3d-40ed-8c4a-eb7328a5de83" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:26 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7771ae1a-d185-4d1c-85bd-33f33459dd8e tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-quobyte-d1658815-2a3d-40ed-8c4a-eb7328a5de83" acquired by "delete_volume" :: waited 0.031s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:26 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 Jul 07 22:15:26 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:26 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd63f8c6-e335-414b-8b40-1ad2ff241ce6]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7771ae1a-d185-4d1c-85bd-33f33459dd8e tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d1658815-2a3d-40ed-8c4a-eb7328a5de83 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:26 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d1658815-2a3d-40ed-8c4a-eb7328a5de83 Jul 07 22:15:26 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:26 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d1f13175-d93e-4f97-9b3d-ebdf70b9fe90 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.739s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:26 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-d1f13175-d93e-4f97-9b3d-ebdf70b9fe90 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:15:26 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d1f13175-d93e-4f97-9b3d-ebdf70b9fe90 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Deleted volume successfully. Jul 07 22:15:26 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d1f13175-d93e-4f97-9b3d-ebdf70b9fe90 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-bb013b07-adb8-4a08-a342-2ab15be532eb-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:26 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e18452f6-5529-4914-b932-cac16af12687_c0aclghp" returned: 1 in 0.782s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e18452f6-5529-4914-b932-cac16af12687_c0aclghp' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:15:26 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[400da1bd-d6b3-4cc2-9414-623083ec196b]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:27 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD Jul 07 22:15:27 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:27 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82" returned: 0 in 0.932s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:27 devstack cinder-volume[87586]: DEBUG cinder.utils [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Path /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3 not found in is_blk_device check {{(pid=87586) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:15:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:27 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3 Jul 07 22:15:27 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:27 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7771ae1a-d185-4d1c-85bd-33f33459dd8e tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d1658815-2a3d-40ed-8c4a-eb7328a5de83" returned: 0 in 0.848s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7771ae1a-d185-4d1c-85bd-33f33459dd8e tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d1658815-2a3d-40ed-8c4a-eb7328a5de83 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:27 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d1658815-2a3d-40ed-8c4a-eb7328a5de83 Jul 07 22:15:27 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:27 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD" returned: 0 in 0.784s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:27 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD Jul 07 22:15:27 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:27 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7771ae1a-d185-4d1c-85bd-33f33459dd8e tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d1658815-2a3d-40ed-8c4a-eb7328a5de83" returned: 0 in 0.670s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7771ae1a-d185-4d1c-85bd-33f33459dd8e tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-quobyte-d1658815-2a3d-40ed-8c4a-eb7328a5de83" released by "delete_volume" :: held 1.592s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:28 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-7771ae1a-d185-4d1c-85bd-33f33459dd8e tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Created reservations ['17c6bd9e-a566-4b74-8b58-c27652d0bc54', '54c1d2b2-4b4e-427d-8749-217ab17eebb6', 'd64e7e8d-cbb9-437a-8e16-b10da177ae85', '049c95bb-27f2-453d-afd5-fb83a835e8f8'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:15:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7771ae1a-d185-4d1c-85bd-33f33459dd8e tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7771ae1a-d185-4d1c-85bd-33f33459dd8e tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7771ae1a-d185-4d1c-85bd-33f33459dd8e tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7771ae1a-d185-4d1c-85bd-33f33459dd8e tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7771ae1a-d185-4d1c-85bd-33f33459dd8e tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7771ae1a-d185-4d1c-85bd-33f33459dd8e tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:28 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:15:28 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9d40a38d-ccb9-4ef3-8e2a-7216c3092a77 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "cinder-68e26ec4-567f-444e-a03d-07d376df2080-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9d40a38d-ccb9-4ef3-8e2a-7216c3092a77 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-68e26ec4-567f-444e-a03d-07d376df2080-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9d40a38d-ccb9-4ef3-8e2a-7216c3092a77 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "cinder-quobyte-68e26ec4-567f-444e-a03d-07d376df2080" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:28 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9d40a38d-ccb9-4ef3-8e2a-7216c3092a77 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-quobyte-68e26ec4-567f-444e-a03d-07d376df2080" acquired by "delete_volume" :: waited 0.034s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:28 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c38da2-4270-478f-a13c-ffbf1e3ad8ea]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d40a38d-ccb9-4ef3-8e2a-7216c3092a77 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68e26ec4-567f-444e-a03d-07d376df2080 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:29 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68e26ec4-567f-444e-a03d-07d376df2080 Jul 07 22:15:29 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:29 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD" returned: 1 in 1.685s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:15:29 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] e18452f6-5529-4914-b932-cac16af12687 was raw, converting to raw {{(pid=87586) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:15:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:29 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414 Jul 07 22:15:29 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:30 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7771ae1a-d185-4d1c-85bd-33f33459dd8e tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 2.109s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:30 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-7771ae1a-d185-4d1c-85bd-33f33459dd8e tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:15:30 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-7771ae1a-d185-4d1c-85bd-33f33459dd8e tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Deleted volume successfully. Jul 07 22:15:30 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-7771ae1a-d185-4d1c-85bd-33f33459dd8e tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-d1658815-2a3d-40ed-8c4a-eb7328a5de83-delete_volume" released by "delete_volume" :: held 4.503s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:31 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d40a38d-ccb9-4ef3-8e2a-7216c3092a77 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68e26ec4-567f-444e-a03d-07d376df2080" returned: 0 in 2.072s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d40a38d-ccb9-4ef3-8e2a-7216c3092a77 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68e26ec4-567f-444e-a03d-07d376df2080 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:31 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68e26ec4-567f-444e-a03d-07d376df2080 Jul 07 22:15:31 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:31 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414" returned: 0 in 2.076s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:31 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e18452f6-5529-4914-b932-cac16af12687_w6hx_xekdevstack@QuobyteHD, size 0.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414 {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:15:31 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 22:15:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:31 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414 1G Jul 07 22:15:31 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:32 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d40a38d-ccb9-4ef3-8e2a-7216c3092a77 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68e26ec4-567f-444e-a03d-07d376df2080" returned: 0 in 1.643s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:32 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9d40a38d-ccb9-4ef3-8e2a-7216c3092a77 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-quobyte-68e26ec4-567f-444e-a03d-07d376df2080" released by "delete_volume" :: held 3.832s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:32 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3" returned: 0 in 5.542s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:32 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5918d2-0314-4d71-9614-bd5a467be5ec]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:32 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-9d40a38d-ccb9-4ef3-8e2a-7216c3092a77 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Created reservations ['15a6b527-d0c6-45d8-a99b-e775692600d3', '07e52d1c-5e46-4e5e-8c34-3584b7f2e8e4', '681fec4c-e4cb-4def-9448-f47c7d850aae', '694786a7-66cb-426e-9e05-259a3a53168e'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:15:32 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 Jul 07 22:15:32 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9d40a38d-ccb9-4ef3-8e2a-7216c3092a77 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9d40a38d-ccb9-4ef3-8e2a-7216c3092a77 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9d40a38d-ccb9-4ef3-8e2a-7216c3092a77 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9d40a38d-ccb9-4ef3-8e2a-7216c3092a77 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9d40a38d-ccb9-4ef3-8e2a-7216c3092a77 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d40a38d-ccb9-4ef3-8e2a-7216c3092a77 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:32 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:15:32 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:32 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414 1G" returned: 0 in 1.323s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:32 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23a303c-3000-4f93-b174-9cbc462d05e1]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:33 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414 Jul 07 22:15:33 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-78036317-ccab-4623-bf2d-4787f4284415 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "cinder-c81f60f0-9a6f-4174-afb4-a3355e6ad591-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-78036317-ccab-4623-bf2d-4787f4284415 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-c81f60f0-9a6f-4174-afb4-a3355e6ad591-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:33 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d40a38d-ccb9-4ef3-8e2a-7216c3092a77 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.682s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:33 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-9d40a38d-ccb9-4ef3-8e2a-7216c3092a77 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:15:33 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-9d40a38d-ccb9-4ef3-8e2a-7216c3092a77 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Deleted volume successfully. Jul 07 22:15:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-78036317-ccab-4623-bf2d-4787f4284415 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "cinder-quobyte-c81f60f0-9a6f-4174-afb4-a3355e6ad591" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-78036317-ccab-4623-bf2d-4787f4284415 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-quobyte-c81f60f0-9a6f-4174-afb4-a3355e6ad591" acquired by "delete_volume" :: waited 0.030s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9d40a38d-ccb9-4ef3-8e2a-7216c3092a77 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-68e26ec4-567f-444e-a03d-07d376df2080-delete_volume" released by "delete_volume" :: held 4.920s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:33 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d158dc-e2b6-48e9-9783-4b7956fd8630]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-78036317-ccab-4623-bf2d-4787f4284415 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c81f60f0-9a6f-4174-afb4-a3355e6ad591 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:33 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82" returned: 0 in 1.035s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:33 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Image conversion details: src /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3 {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:15:33 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Converted 1024.00 MB image at 184.70 MB/s Jul 07 22:15:33 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3 is being set with open permissions: ugo+rw Jul 07 22:15:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:33 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c81f60f0-9a6f-4174-afb4-a3355e6ad591 Jul 07 22:15:33 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:33 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3 Jul 07 22:15:33 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:33 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414" returned: 0 in 0.915s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:33 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414 Jul 07 22:15:33 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:34 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3" returned: 0 in 0.689s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Lock "cinder-quobyte-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3" released by "_copy_volume_from_snapshot" :: held 9.220s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Lock "cinder-quobyte-cac498d7-a04e-42b6-bfac-cd03f8491b23-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3" released by "_create_volume_from_snapshot" :: held 9.264s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.301s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.569s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-57327501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e44818ea-83ad-4e7f-a312-dcd0f8e6576b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484acbf1ac4044348d8bd288d3754141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:26Z,use_quota=True,user_id='1726058cd1bb40c5a62b34317c8abc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Creating volume e44818ea-83ad-4e7f-a312-dcd0f8e6576b {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:15:34 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:34 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b 1073741824 Jul 07 22:15:34 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103e78d9-10d1-49a7-83b6-d4b6e4e907b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3', 'volume_size': 1, 'snapshot_id': 'cac498d7-a04e-42b6-bfac-cd03f8491b23'}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553f0155-3aac-45b3-bed4-5174854e92e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:34 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Volume volume-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3 (4f3e7d6f-d92c-4859-98d3-a5578c25b5a3): created successfully Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553f0155-3aac-45b3-bed4-5174854e92e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:34 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Flow 'volume_create_manager' (125f7e36-5a39-4d7d-9639-9719435d248f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-78036317-ccab-4623-bf2d-4787f4284415 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c81f60f0-9a6f-4174-afb4-a3355e6ad591" returned: 0 in 0.929s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-78036317-ccab-4623-bf2d-4787f4284415 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c81f60f0-9a6f-4174-afb4-a3355e6ad591 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:34 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-3bf3019a-0edb-48fa-b84d-74c37e4e3eae tempest-VolumeDependencyTests-1752792086 None] Created volume successfully. Jul 07 22:15:34 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c81f60f0-9a6f-4174-afb4-a3355e6ad591 Jul 07 22:15:34 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:34 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414" returned: 1 in 0.812s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Downloaded image e18452f6-5529-4914-b932-cac16af12687 ((None, [{'url': 'file:///opt/stack/data/glance/images/e18452f6-5529-4914-b932-cac16af12687', 'metadata': {}}])) to volume d8769dc6-533e-4983-b53f-4a1a9a097414 successfully. {{(pid=87586) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Temporary image e18452f6-5529-4914-b932-cac16af12687 for user 85a3da11f408406ea340215ddb967105 is deleted. {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Marking volume d8769dc6-533e-4983-b53f-4a1a9a097414 as bootable. {{(pid=87586) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Copying metadata from image e18452f6-5529-4914-b932-cac16af12687 to d8769dc6-533e-4983-b53f-4a1a9a097414. {{(pid=87586) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Creating volume glance metadata for volume d8769dc6-533e-4983-b53f-4a1a9a097414 backed by image e18452f6-5529-4914-b932-cac16af12687 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e18452f6-5529-4914-b932-cac16af12687', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b684a67e4000624719281daa5ad56ada', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87586) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb32691-8b6c-4144-8945-9dccf82f194d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8769dc6-533e-4983-b53f-4a1a9a097414', 'volume_size': 1, 'image_id': 'e18452f6-5529-4914-b932-cac16af12687', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e18452f6-5529-4914-b932-cac16af12687', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b684a67e4000624719281daa5ad56ada', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '635b070ae0554982b5ec9e370fbd19f1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed0c19f636d82335cf3ebbe2d45943586e5651b612c1ab2df186796c1a653580d348ad7eb604f93f8c853ec7fd742aa02ee66f5b49eee6e4802476075a96821d', 'id': 'e18452f6-5529-4914-b932-cac16af12687', 'created_at': datetime.datetime(2026, 7, 7, 20, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 15, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e18452f6-5529-4914-b932-cac16af12687/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904daf7c-fb4a-46b1-83c7-b539f6303494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:34 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Volume volume-d8769dc6-533e-4983-b53f-4a1a9a097414 (d8769dc6-533e-4983-b53f-4a1a9a097414): created successfully Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904daf7c-fb4a-46b1-83c7-b539f6303494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Flow 'volume_create_manager' (a877e9d2-f731-4e10-8b21-9540606bc38b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:34 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-2f5429a2-69b2-4754-9d66-3035cce48f15 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Created volume successfully. Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9818470b-2862-485d-be80-68f173e3149a tempest-VolumeDependencyTests-1752792086 None] Acquiring lock "cinder-cac498d7-a04e-42b6-bfac-cd03f8491b23-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9818470b-2862-485d-be80-68f173e3149a tempest-VolumeDependencyTests-1752792086 None] Lock "cinder-cac498d7-a04e-42b6-bfac-cd03f8491b23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9818470b-2862-485d-be80-68f173e3149a tempest-VolumeDependencyTests-1752792086 None] Acquiring lock "cinder-quobyte-7a6021e8-bc33-48f8-98a7-3303c40f6c82" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9818470b-2862-485d-be80-68f173e3149a tempest-VolumeDependencyTests-1752792086 None] Lock "cinder-quobyte-7a6021e8-bc33-48f8-98a7-3303c40f6c82" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9818470b-2862-485d-be80-68f173e3149a tempest-VolumeDependencyTests-1752792086 None] Acquiring lock "cinder-quobyte-cac498d7-a04e-42b6-bfac-cd03f8491b23" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9818470b-2862-485d-be80-68f173e3149a tempest-VolumeDependencyTests-1752792086 None] Lock "cinder-quobyte-cac498d7-a04e-42b6-bfac-cd03f8491b23" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-9818470b-2862-485d-be80-68f173e3149a tempest-VolumeDependencyTests-1752792086 None] Deleting offline snapshot cac498d7-a04e-42b6-bfac-cd03f8491b23 of volume 7a6021e8-bc33-48f8-98a7-3303c40f6c82 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-9818470b-2862-485d-be80-68f173e3149a tempest-VolumeDependencyTests-1752792086 None] snapshot_file for this snap is: volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5181edb-a2d4-4b9a-a800-40561ba7eb9a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9818470b-2862-485d-be80-68f173e3149a tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Acquiring lock "cinder-d8769dc6-533e-4983-b53f-4a1a9a097414-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:35 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-78036317-ccab-4623-bf2d-4787f4284415 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c81f60f0-9a6f-4174-afb4-a3355e6ad591" returned: 0 in 0.855s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:35 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23 Jul 07 22:15:35 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Lock "cinder-d8769dc6-533e-4983-b53f-4a1a9a097414-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-78036317-ccab-4623-bf2d-4787f4284415 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-quobyte-c81f60f0-9a6f-4174-afb4-a3355e6ad591" released by "delete_volume" :: held 1.851s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:35 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Acquiring lock "cinder-quobyte-d8769dc6-533e-4983-b53f-4a1a9a097414" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b 1073741824" returned: 0 in 1.024s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Lock "cinder-quobyte-d8769dc6-533e-4983-b53f-4a1a9a097414" acquired by "delete_volume" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-78036317-ccab-4623-bf2d-4787f4284415 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Created reservations ['84bcdf31-495e-4ba9-9e97-9671cfafd2a3', '8ea767f9-c67a-4609-ad85-efd8db49bc4f', 'a802291f-990d-4be5-bcfd-57ce7b2249c5', 'e35f2f0c-ce97-48fb-bf87-c3d5dbd858e0'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[048eea3d-7b37-4419-8694-26b4167045eb]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:35 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b Jul 07 22:15:35 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:35 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:15:35 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-78036317-ccab-4623-bf2d-4787f4284415 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-78036317-ccab-4623-bf2d-4787f4284415 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-78036317-ccab-4623-bf2d-4787f4284415 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-78036317-ccab-4623-bf2d-4787f4284415 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-78036317-ccab-4623-bf2d-4787f4284415 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:35 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414 Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-78036317-ccab-4623-bf2d-4787f4284415 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:35 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a81b20a0-00f2-45dc-b412-c79af92e6d09 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "cinder-6058172a-7e50-494e-aa3f-51c2ec7c1041-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:35 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:15:35 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a81b20a0-00f2-45dc-b412-c79af92e6d09 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-6058172a-7e50-494e-aa3f-51c2ec7c1041-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a81b20a0-00f2-45dc-b412-c79af92e6d09 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "cinder-quobyte-6058172a-7e50-494e-aa3f-51c2ec7c1041" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a81b20a0-00f2-45dc-b412-c79af92e6d09 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-quobyte-6058172a-7e50-494e-aa3f-51c2ec7c1041" acquired by "delete_volume" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6a0b1c-7a05-4f90-a49a-bc5f68d89520]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a81b20a0-00f2-45dc-b412-c79af92e6d09 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6058172a-7e50-494e-aa3f-51c2ec7c1041 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:36 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6058172a-7e50-494e-aa3f-51c2ec7c1041 Jul 07 22:15:36 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:36 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9818470b-2862-485d-be80-68f173e3149a tempest-VolumeDependencyTests-1752792086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23" returned: 0 in 1.376s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:36 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-9818470b-2862-485d-be80-68f173e3149a tempest-VolumeDependencyTests-1752792086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:15:36 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c121ec-d27a-43d4-b6ed-b783aeab310a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9818470b-2862-485d-be80-68f173e3149a tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:36 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-78036317-ccab-4623-bf2d-4787f4284415 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.016s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-78036317-ccab-4623-bf2d-4787f4284415 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:15:36 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-78036317-ccab-4623-bf2d-4787f4284415 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Deleted volume successfully. Jul 07 22:15:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-78036317-ccab-4623-bf2d-4787f4284415 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-c81f60f0-9a6f-4174-afb4-a3355e6ad591-delete_volume" released by "delete_volume" :: held 3.333s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:36 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414" returned: 0 in 1.275s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:36 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 Jul 07 22:15:36 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:36 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b" returned: 0 in 1.355s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:36 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] <== create_volume: return (2456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:15:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.461s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481836fc-238c-44e7-901f-e0f27db0debc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b5f71e-1a60-4854-ac62-e0fc5285367d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:37 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Volume volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b (e44818ea-83ad-4e7f-a312-dcd0f8e6576b): created successfully Jul 07 22:15:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b5f71e-1a60-4854-ac62-e0fc5285367d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Flow 'volume_create_manager' (ec86c2d4-defa-4c2b-900f-eda278757dd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:37 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-8030c4d0-50e2-4f21-b6ca-f454891e2e89 tempest-CreateVolumesFromSnapshotTest-902813832 None] Created volume successfully. Jul 07 22:15:37 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414 Jul 07 22:15:37 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:37 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:37 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.633s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:37 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:15:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a81b20a0-00f2-45dc-b412-c79af92e6d09 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6058172a-7e50-494e-aa3f-51c2ec7c1041" returned: 0 in 1.292s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a81b20a0-00f2-45dc-b412-c79af92e6d09 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6058172a-7e50-494e-aa3f-51c2ec7c1041 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:37 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:15:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 28 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 22:15:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 22:15:37 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6058172a-7e50-494e-aa3f-51c2ec7c1041 Jul 07 22:15:37 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:37 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9818470b-2862-485d-be80-68f173e3149a tempest-VolumeDependencyTests-1752792086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82" returned: 0 in 0.974s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9818470b-2862-485d-be80-68f173e3149a tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:37 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23 Jul 07 22:15:37 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:37 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414" returned: 1 in 0.959s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:15:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:37 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414 Jul 07 22:15:37 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:37 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a81b20a0-00f2-45dc-b412-c79af92e6d09 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6058172a-7e50-494e-aa3f-51c2ec7c1041" returned: 0 in 0.734s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a81b20a0-00f2-45dc-b412-c79af92e6d09 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-quobyte-6058172a-7e50-494e-aa3f-51c2ec7c1041" released by "delete_volume" :: held 2.101s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-a81b20a0-00f2-45dc-b412-c79af92e6d09 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Created reservations ['92cb0438-03fe-4cd0-83c6-6e5408c84041', '2cbf393a-2bca-4504-a89c-e7b15fb86644', '24f052e3-d280-43bf-aeb2-5d9e4bbd8af3', 'b1be579e-3108-46e8-b88f-e7699d39403a'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a81b20a0-00f2-45dc-b412-c79af92e6d09 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a81b20a0-00f2-45dc-b412-c79af92e6d09 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a81b20a0-00f2-45dc-b412-c79af92e6d09 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a81b20a0-00f2-45dc-b412-c79af92e6d09 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a81b20a0-00f2-45dc-b412-c79af92e6d09 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a81b20a0-00f2-45dc-b412-c79af92e6d09 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:38 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:15:38 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9ca0fe03-9e72-4c99-a4b0-0d00a7007e88 tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9ca0fe03-9e72-4c99-a4b0-0d00a7007e88 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-9ca0fe03-9e72-4c99-a4b0-0d00a7007e88 tempest-CreateVolumesFromSnapshotTest-902813832 None] Creating offline snapshot e03fc7bb-aaee-4046-b8ce-097f9c11f9da of volume e44818ea-83ad-4e7f-a312-dcd0f8e6576b {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7450096-4f78-46c1-baee-326395a57fe9]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9ca0fe03-9e72-4c99-a4b0-0d00a7007e88 tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:38 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b Jul 07 22:15:38 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:38 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9818470b-2862-485d-be80-68f173e3149a tempest-VolumeDependencyTests-1752792086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23" returned: 0 in 0.894s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9818470b-2862-485d-be80-68f173e3149a tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:38 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23 Jul 07 22:15:38 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:38 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-d8769dc6-533e-4983-b53f-4a1a9a097414" returned: 0 in 0.778s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Lock "cinder-quobyte-d8769dc6-533e-4983-b53f-4a1a9a097414" released by "delete_volume" :: held 3.097s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Created reservations ['6ebf2f4a-b5a1-46fc-95b7-07eb62a711c7', '6cac0755-6aca-493c-a538-a36ba920dbb9', '2a863d1c-a844-47a4-8379-aa514b6f77fa', 'b44d788d-ffa9-4371-af90-3353d8fb7e5b'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:38 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:15:38 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:39 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a81b20a0-00f2-45dc-b412-c79af92e6d09 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.873s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:39 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-a81b20a0-00f2-45dc-b412-c79af92e6d09 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:15:39 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-a81b20a0-00f2-45dc-b412-c79af92e6d09 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Deleted volume successfully. Jul 07 22:15:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a81b20a0-00f2-45dc-b412-c79af92e6d09 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-6058172a-7e50-494e-aa3f-51c2ec7c1041-delete_volume" released by "delete_volume" :: held 3.349s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ba765697-edcd-41d2-8017-3cf715994b25 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "cinder-ce40a627-a4e1-4d14-b16e-bed5b7f2f301-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:39 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9818470b-2862-485d-be80-68f173e3149a tempest-VolumeDependencyTests-1752792086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82.cac498d7-a04e-42b6-bfac-cd03f8491b23" returned: 0 in 0.876s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ba765697-edcd-41d2-8017-3cf715994b25 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-ce40a627-a4e1-4d14-b16e-bed5b7f2f301-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9818470b-2862-485d-be80-68f173e3149a tempest-VolumeDependencyTests-1752792086 None] Lock "cinder-quobyte-cac498d7-a04e-42b6-bfac-cd03f8491b23" released by "_delete_snapshot" :: held 4.270s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9818470b-2862-485d-be80-68f173e3149a tempest-VolumeDependencyTests-1752792086 None] Lock "cinder-quobyte-7a6021e8-bc33-48f8-98a7-3303c40f6c82" released by "delete_snapshot" :: held 4.300s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ba765697-edcd-41d2-8017-3cf715994b25 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "cinder-quobyte-ce40a627-a4e1-4d14-b16e-bed5b7f2f301" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ba765697-edcd-41d2-8017-3cf715994b25 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-quobyte-ce40a627-a4e1-4d14-b16e-bed5b7f2f301" acquired by "delete_volume" :: waited 0.025s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:39 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f69bf9c-d32a-45e4-b532-e8c803790cc3]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba765697-edcd-41d2-8017-3cf715994b25 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce40a627-a4e1-4d14-b16e-bed5b7f2f301 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:39 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9ca0fe03-9e72-4c99-a4b0-0d00a7007e88 tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b" returned: 0 in 1.196s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9ca0fe03-9e72-4c99-a4b0-0d00a7007e88 tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.e03fc7bb-aaee-4046-b8ce-097f9c11f9da 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:39 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-9818470b-2862-485d-be80-68f173e3149a tempest-VolumeDependencyTests-1752792086 None] Created reservations ['9b98268a-d9b0-4702-9f40-8da7b013ae15', '43a0aaa8-1625-4c25-a065-dce9bd76570f', 'cdd46a94-f402-4fae-8133-e93d6e33cbb2', '10c69a61-b5ab-4108-a538-40784a834946'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:15:39 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.e03fc7bb-aaee-4046-b8ce-097f9c11f9da 1G Jul 07 22:15:39 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:39 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:39 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-9818470b-2862-485d-be80-68f173e3149a tempest-VolumeDependencyTests-1752792086 None] Delete snapshot completed successfully. Jul 07 22:15:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.952s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:39 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:15:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9818470b-2862-485d-be80-68f173e3149a tempest-VolumeDependencyTests-1752792086 None] Lock "cinder-cac498d7-a04e-42b6-bfac-cd03f8491b23-delete_snapshot" released by "delete_snapshot" :: held 4.549s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:39 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Deleted volume successfully. Jul 07 22:15:39 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce40a627-a4e1-4d14-b16e-bed5b7f2f301 Jul 07 22:15:39 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-afd662c3-a7ef-4eee-a44d-05c0f2f399c4 tempest-VolumeAndVolumeTypeFromImageTest-168530026 None] Lock "cinder-d8769dc6-533e-4983-b53f-4a1a9a097414-delete_volume" released by "delete_volume" :: held 4.329s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:40 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba765697-edcd-41d2-8017-3cf715994b25 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce40a627-a4e1-4d14-b16e-bed5b7f2f301" returned: 0 in 0.801s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba765697-edcd-41d2-8017-3cf715994b25 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce40a627-a4e1-4d14-b16e-bed5b7f2f301 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:40 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce40a627-a4e1-4d14-b16e-bed5b7f2f301 Jul 07 22:15:40 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:40 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9ca0fe03-9e72-4c99-a4b0-0d00a7007e88 tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.e03fc7bb-aaee-4046-b8ce-097f9c11f9da 1G" returned: 0 in 0.928s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9ca0fe03-9e72-4c99-a4b0-0d00a7007e88 tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.e03fc7bb-aaee-4046-b8ce-097f9c11f9da {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:40 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.e03fc7bb-aaee-4046-b8ce-097f9c11f9da Jul 07 22:15:40 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3fde3671-9438-4064-ac29-e38df0f21eff tempest-VolumeDependencyTests-1752792086 None] Acquiring lock "cinder-7a6021e8-bc33-48f8-98a7-3303c40f6c82-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3fde3671-9438-4064-ac29-e38df0f21eff tempest-VolumeDependencyTests-1752792086 None] Lock "cinder-7a6021e8-bc33-48f8-98a7-3303c40f6c82-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3fde3671-9438-4064-ac29-e38df0f21eff tempest-VolumeDependencyTests-1752792086 None] Acquiring lock "cinder-quobyte-7a6021e8-bc33-48f8-98a7-3303c40f6c82" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3fde3671-9438-4064-ac29-e38df0f21eff tempest-VolumeDependencyTests-1752792086 None] Lock "cinder-quobyte-7a6021e8-bc33-48f8-98a7-3303c40f6c82" acquired by "delete_volume" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:40 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc62dc8a-9445-458c-963b-c9aa8fb7042c]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3fde3671-9438-4064-ac29-e38df0f21eff tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:40 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 Jul 07 22:15:40 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:41 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba765697-edcd-41d2-8017-3cf715994b25 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ce40a627-a4e1-4d14-b16e-bed5b7f2f301" returned: 0 in 0.800s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:41 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ba765697-edcd-41d2-8017-3cf715994b25 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-quobyte-ce40a627-a4e1-4d14-b16e-bed5b7f2f301" released by "delete_volume" :: held 1.678s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:41 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-ba765697-edcd-41d2-8017-3cf715994b25 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Created reservations ['261aa5a1-ff9f-4142-8f6c-9c2b291de390', 'f41e3dc2-9a5d-4f72-a868-b2d886fe578b', '72fcedcc-ae03-4afb-81f6-7d2f91396087', 'd5d1a43f-6452-426e-b2a3-c08f73a6a5fd'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:15:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ba765697-edcd-41d2-8017-3cf715994b25 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ba765697-edcd-41d2-8017-3cf715994b25 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ba765697-edcd-41d2-8017-3cf715994b25 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ba765697-edcd-41d2-8017-3cf715994b25 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ba765697-edcd-41d2-8017-3cf715994b25 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba765697-edcd-41d2-8017-3cf715994b25 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:41 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9ca0fe03-9e72-4c99-a4b0-0d00a7007e88 tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.e03fc7bb-aaee-4046-b8ce-097f9c11f9da" returned: 0 in 0.874s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:41 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-9ca0fe03-9e72-4c99-a4b0-0d00a7007e88 tempest-CreateVolumesFromSnapshotTest-902813832 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.e03fc7bb-aaee-4046-b8ce-097f9c11f9da is being set with open permissions: ugo+rw Jul 07 22:15:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9ca0fe03-9e72-4c99-a4b0-0d00a7007e88 tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.e03fc7bb-aaee-4046-b8ce-097f9c11f9da {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:41 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:15:41 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:41 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.e03fc7bb-aaee-4046-b8ce-097f9c11f9da Jul 07 22:15:41 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:41 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3fde3671-9438-4064-ac29-e38df0f21eff tempest-VolumeDependencyTests-1752792086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82" returned: 0 in 0.906s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3fde3671-9438-4064-ac29-e38df0f21eff tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:41 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82 Jul 07 22:15:41 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:42 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ba765697-edcd-41d2-8017-3cf715994b25 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.947s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:42 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-ba765697-edcd-41d2-8017-3cf715994b25 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:15:42 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ba765697-edcd-41d2-8017-3cf715994b25 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Deleted volume successfully. Jul 07 22:15:42 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9ca0fe03-9e72-4c99-a4b0-0d00a7007e88 tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.e03fc7bb-aaee-4046-b8ce-097f9c11f9da" returned: 0 in 0.964s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ba765697-edcd-41d2-8017-3cf715994b25 tempest-CreateVolumesFromSourceVolumeTest-1820347280 None] Lock "cinder-ce40a627-a4e1-4d14-b16e-bed5b7f2f301-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9ca0fe03-9e72-4c99-a4b0-0d00a7007e88 tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:42 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.info Jul 07 22:15:42 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:42 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3fde3671-9438-4064-ac29-e38df0f21eff tempest-VolumeDependencyTests-1752792086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7a6021e8-bc33-48f8-98a7-3303c40f6c82" returned: 0 in 0.874s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3fde3671-9438-4064-ac29-e38df0f21eff tempest-VolumeDependencyTests-1752792086 None] Lock "cinder-quobyte-7a6021e8-bc33-48f8-98a7-3303c40f6c82" released by "delete_volume" :: held 1.846s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:42 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-3fde3671-9438-4064-ac29-e38df0f21eff tempest-VolumeDependencyTests-1752792086 None] Created reservations ['17c67f5c-a019-4728-a272-b16ec32b034c', 'c83f2bd4-b5c9-488b-a241-b4a02454ca98', 'b14ae20f-cabc-46f7-8aab-45a81bf49b0c', 'b3a674a0-e7fb-4f82-949d-8926066a1165'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:15:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3fde3671-9438-4064-ac29-e38df0f21eff tempest-VolumeDependencyTests-1752792086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3fde3671-9438-4064-ac29-e38df0f21eff tempest-VolumeDependencyTests-1752792086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3fde3671-9438-4064-ac29-e38df0f21eff tempest-VolumeDependencyTests-1752792086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:42 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3fde3671-9438-4064-ac29-e38df0f21eff tempest-VolumeDependencyTests-1752792086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3fde3671-9438-4064-ac29-e38df0f21eff tempest-VolumeDependencyTests-1752792086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3fde3671-9438-4064-ac29-e38df0f21eff tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:42 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:15:42 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:42 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-41dbf9aa-0f3d-48c8-89a8-847d99412f68 tempest-VolumeDependencyTests-1752792086 None] Acquiring lock "cinder-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-41dbf9aa-0f3d-48c8-89a8-847d99412f68 tempest-VolumeDependencyTests-1752792086 None] Lock "cinder-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-41dbf9aa-0f3d-48c8-89a8-847d99412f68 tempest-VolumeDependencyTests-1752792086 None] Acquiring lock "cinder-quobyte-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-41dbf9aa-0f3d-48c8-89a8-847d99412f68 tempest-VolumeDependencyTests-1752792086 None] Lock "cinder-quobyte-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3" acquired by "delete_volume" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:43 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f925a6-ae35-4922-a6b6-f0237c5ed334]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-41dbf9aa-0f3d-48c8-89a8-847d99412f68 tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:43 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3 Jul 07 22:15:43 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:43 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3fde3671-9438-4064-ac29-e38df0f21eff tempest-VolumeDependencyTests-1752792086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.820s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:43 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-3fde3671-9438-4064-ac29-e38df0f21eff tempest-VolumeDependencyTests-1752792086 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:15:43 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-3fde3671-9438-4064-ac29-e38df0f21eff tempest-VolumeDependencyTests-1752792086 None] Deleted volume successfully. Jul 07 22:15:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3fde3671-9438-4064-ac29-e38df0f21eff tempest-VolumeDependencyTests-1752792086 None] Lock "cinder-7a6021e8-bc33-48f8-98a7-3303c40f6c82-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:43 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9ca0fe03-9e72-4c99-a4b0-0d00a7007e88 tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.info" returned: 0 in 1.188s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:43 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-9ca0fe03-9e72-4c99-a4b0-0d00a7007e88 tempest-CreateVolumesFromSnapshotTest-902813832 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.info is being set with open permissions: ugo+rw Jul 07 22:15:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9ca0fe03-9e72-4c99-a4b0-0d00a7007e88 tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:43 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.info Jul 07 22:15:43 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:44 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-41dbf9aa-0f3d-48c8-89a8-847d99412f68 tempest-VolumeDependencyTests-1752792086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3" returned: 0 in 1.210s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-41dbf9aa-0f3d-48c8-89a8-847d99412f68 tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:44 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3 Jul 07 22:15:44 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:44 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9ca0fe03-9e72-4c99-a4b0-0d00a7007e88 tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.info" returned: 0 in 0.838s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9ca0fe03-9e72-4c99-a4b0-0d00a7007e88 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.101s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:44 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-9ca0fe03-9e72-4c99-a4b0-0d00a7007e88 tempest-CreateVolumesFromSnapshotTest-902813832 None] Create snapshot completed successfully Jul 07 22:15:45 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-41dbf9aa-0f3d-48c8-89a8-847d99412f68 tempest-VolumeDependencyTests-1752792086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3" returned: 0 in 0.815s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-41dbf9aa-0f3d-48c8-89a8-847d99412f68 tempest-VolumeDependencyTests-1752792086 None] Lock "cinder-quobyte-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3" released by "delete_volume" :: held 2.093s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-41dbf9aa-0f3d-48c8-89a8-847d99412f68 tempest-VolumeDependencyTests-1752792086 None] Created reservations ['2b1605a9-208f-4614-bfb1-bfa50f0b8594', '022ecdfc-cb69-45da-b7af-88a92ca93671', '2616ab1e-5cda-4314-816d-7e51360aecf3', 'cfe7328a-f01a-4a02-91d3-aed1dc005c00'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Flow 'volume_create_manager' (406dac2e-fb0f-49c6-9804-97e437803800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24635f7d-eda0-48b7-888d-6911582df838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24635f7d-eda0-48b7-888d-6911582df838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1057604856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f12c4f-3ba0-4893-8802-555e1a56997d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484acbf1ac4044348d8bd288d3754141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:45Z,use_quota=True,user_id='1726058cd1bb40c5a62b34317c8abc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c09a8a-df1c-48c3-9afd-5ee135cac8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c09a8a-df1c-48c3-9afd-5ee135cac8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd1af3ac-7411-4b72-bebf-3fa67270fb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd1af3ac-7411-4b72-bebf-3fa67270fb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3f12c4f-3ba0-4893-8802-555e1a56997d', 'volume_name': 'volume-b3f12c4f-3ba0-4893-8802-555e1a56997d', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d2e2345-0ee5-42dc-9cbf-09b045bd1cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d2e2345-0ee5-42dc-9cbf-09b045bd1cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d125da71-3385-4b79-90ec-687aaf1f9b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:45 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Volume b3f12c4f-3ba0-4893-8802-555e1a56997d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3f12c4f-3ba0-4893-8802-555e1a56997d', 'volume_size': 1} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1057604856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f12c4f-3ba0-4893-8802-555e1a56997d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484acbf1ac4044348d8bd288d3754141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:45Z,use_quota=True,user_id='1726058cd1bb40c5a62b34317c8abc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Creating volume b3f12c4f-3ba0-4893-8802-555e1a56997d {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:15:45 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b3f12c4f-3ba0-4893-8802-555e1a56997d 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:45 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b3f12c4f-3ba0-4893-8802-555e1a56997d 1073741824 Jul 07 22:15:45 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-41dbf9aa-0f3d-48c8-89a8-847d99412f68 tempest-VolumeDependencyTests-1752792086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-41dbf9aa-0f3d-48c8-89a8-847d99412f68 tempest-VolumeDependencyTests-1752792086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-41dbf9aa-0f3d-48c8-89a8-847d99412f68 tempest-VolumeDependencyTests-1752792086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-41dbf9aa-0f3d-48c8-89a8-847d99412f68 tempest-VolumeDependencyTests-1752792086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-41dbf9aa-0f3d-48c8-89a8-847d99412f68 tempest-VolumeDependencyTests-1752792086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-41dbf9aa-0f3d-48c8-89a8-847d99412f68 tempest-VolumeDependencyTests-1752792086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:45 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:15:45 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Flow 'volume_create_manager' (a7a19f67-20c3-46c8-ac3c-90b97cd0a811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf5beb3-c2c3-4589-8521-89690d662c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf5beb3-c2c3-4589-8521-89690d662c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-194286303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64698282-38ec-4c1b-a1f7-107d729c1945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484acbf1ac4044348d8bd288d3754141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:46Z,use_quota=True,user_id='1726058cd1bb40c5a62b34317c8abc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3efcdaf6-39ca-4313-9c0e-42882276c240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3efcdaf6-39ca-4313-9c0e-42882276c240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457735cd-5b88-45f8-b90a-66321118fd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457735cd-5b88-45f8-b90a-66321118fd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64698282-38ec-4c1b-a1f7-107d729c1945', 'volume_name': 'volume-64698282-38ec-4c1b-a1f7-107d729c1945', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64e5c8a-d268-40ae-9f88-de39d2209634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64e5c8a-d268-40ae-9f88-de39d2209634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119d10bf-1f09-4698-883b-48023af534a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:45 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Volume 64698282-38ec-4c1b-a1f7-107d729c1945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64698282-38ec-4c1b-a1f7-107d729c1945', 'volume_size': 1} Jul 07 22:15:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:46 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-41dbf9aa-0f3d-48c8-89a8-847d99412f68 tempest-VolumeDependencyTests-1752792086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.830s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:46 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-41dbf9aa-0f3d-48c8-89a8-847d99412f68 tempest-VolumeDependencyTests-1752792086 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:15:46 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-41dbf9aa-0f3d-48c8-89a8-847d99412f68 tempest-VolumeDependencyTests-1752792086 None] Deleted volume successfully. Jul 07 22:15:46 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-41dbf9aa-0f3d-48c8-89a8-847d99412f68 tempest-VolumeDependencyTests-1752792086 None] Lock "cinder-4f3e7d6f-d92c-4859-98d3-a5578c25b5a3-delete_volume" released by "delete_volume" :: held 3.419s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:46 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:15:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Flow 'volume_create_manager' (810256b4-6614-49ac-be9b-ef20a0d9ff97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fedf58f5-dac3-4e80-9e40-cf77f7c1a8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fedf58f5-dac3-4e80-9e40-cf77f7c1a8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1457859492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e16df5b-da7c-4fe0-aea0-637386971455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484acbf1ac4044348d8bd288d3754141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:46Z,use_quota=True,user_id='1726058cd1bb40c5a62b34317c8abc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cceed0a1-8011-4d97-8317-3f9dbcff711c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cceed0a1-8011-4d97-8317-3f9dbcff711c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8794d9e-e247-407f-aa86-bda565d8d43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8794d9e-e247-407f-aa86-bda565d8d43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e16df5b-da7c-4fe0-aea0-637386971455', 'volume_name': 'volume-3e16df5b-da7c-4fe0-aea0-637386971455', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a3d96e-2f64-42dd-9a9f-07537982c728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a3d96e-2f64-42dd-9a9f-07537982c728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:46 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51cdbc6d-5c69-4d6e-8ee3-fe3f421bad83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:46 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Volume 3e16df5b-da7c-4fe0-aea0-637386971455: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e16df5b-da7c-4fe0-aea0-637386971455', 'volume_size': 1} Jul 07 22:15:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:46 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b3f12c4f-3ba0-4893-8802-555e1a56997d 1073741824" returned: 0 in 1.423s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b3f12c4f-3ba0-4893-8802-555e1a56997d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:47 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b3f12c4f-3ba0-4893-8802-555e1a56997d Jul 07 22:15:47 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Flow 'volume_create_manager' (c89f86fe-76f1-4cae-8586-972299916634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a09ddbff-3039-4074-928f-9aec800ee6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a09ddbff-3039-4074-928f-9aec800ee6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-442180657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484acbf1ac4044348d8bd288d3754141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:47Z,use_quota=True,user_id='1726058cd1bb40c5a62b34317c8abc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f89580f-8148-46c9-8f50-2e7b07091658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f89580f-8148-46c9-8f50-2e7b07091658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bc6250d-d4b1-41d2-b0e9-3b0156d4f38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bc6250d-d4b1-41d2-b0e9-3b0156d4f38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7', 'volume_name': 'volume-5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b970e51e-246a-4b01-9330-11906032e741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b970e51e-246a-4b01-9330-11906032e741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1407f038-d9ad-4832-b4a3-540c4024d3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:47 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Volume 5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7', 'volume_size': 1} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:47 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Flow 'volume_create_manager' (a68ebe89-1fe4-45d6-9613-e9e238ec74e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6080b0ae-5d40-4daa-b3ac-25b9bb53d395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b3f12c4f-3ba0-4893-8802-555e1a56997d" returned: 0 in 0.968s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] <== create_volume: return (2466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.469s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.976s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-194286303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64698282-38ec-4c1b-a1f7-107d729c1945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484acbf1ac4044348d8bd288d3754141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:46Z,use_quota=True,user_id='1726058cd1bb40c5a62b34317c8abc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Creating volume 64698282-38ec-4c1b-a1f7-107d729c1945 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:15:47 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-64698282-38ec-4c1b-a1f7-107d729c1945 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6080b0ae-5d40-4daa-b3ac-25b9bb53d395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1754412078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073f5d43-8585-40cc-963e-f93cb0ee8339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484acbf1ac4044348d8bd288d3754141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:48Z,use_quota=True,user_id='1726058cd1bb40c5a62b34317c8abc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:47 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cde8ac5-943b-42d8-ad91-49ec1cb5820a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:48 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-64698282-38ec-4c1b-a1f7-107d729c1945 1073741824 Jul 07 22:15:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cde8ac5-943b-42d8-ad91-49ec1cb5820a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:48 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbbb5b6a-ae27-451b-bbe1-646dfdc5a239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbbb5b6a-ae27-451b-bbe1-646dfdc5a239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '073f5d43-8585-40cc-963e-f93cb0ee8339', 'volume_name': 'volume-073f5d43-8585-40cc-963e-f93cb0ee8339', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9610d29-9d90-484f-b8bd-8d201c559cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9610d29-9d90-484f-b8bd-8d201c559cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba77684d-87c2-4d60-ac2a-4411987ee0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:48 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Volume 073f5d43-8585-40cc-963e-f93cb0ee8339: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-073f5d43-8585-40cc-963e-f93cb0ee8339', 'volume_size': 1} Jul 07 22:15:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d125da71-3385-4b79-90ec-687aaf1f9b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3f12c4f-3ba0-4893-8802-555e1a56997d', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3153710d-e40c-45fe-a592-120c21d4afa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:48 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Volume volume-b3f12c4f-3ba0-4893-8802-555e1a56997d (b3f12c4f-3ba0-4893-8802-555e1a56997d): created successfully Jul 07 22:15:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3153710d-e40c-45fe-a592-120c21d4afa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:48 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Flow 'volume_create_manager' (406dac2e-fb0f-49c6-9804-97e437803800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:48 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-700b0e4f-aed2-4517-8045-7e78b3cf7171 tempest-CreateVolumesFromSnapshotTest-902813832 None] Created volume successfully. Jul 07 22:15:49 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:15:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Flow 'volume_create_manager' (5bd64048-0a02-4e44-a321-75a0647e07aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (063a02c9-d12b-41c3-ae43-ead49989e687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:49 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-64698282-38ec-4c1b-a1f7-107d729c1945 1073741824" returned: 0 in 1.185s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (063a02c9-d12b-41c3-ae43-ead49989e687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c7692b-0825-4de7-9cf1-77f9459bff87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd0b756064794614ab4d3deb38a924d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:49Z,use_quota=True,user_id='6763a2df382c4453809551cc40a1e718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d49afc-6740-4428-966b-4246e94cb37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d49afc-6740-4428-966b-4246e94cb37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca014a5e-b6c4-430d-a487-2cef128f173c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:49 devstack cinder-volume[87586]: DEBUG cinder.image.glance [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Creating Keystone auth plugin from conf {{(pid=87586) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 22:15:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-64698282-38ec-4c1b-a1f7-107d729c1945 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:49 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-64698282-38ec-4c1b-a1f7-107d729c1945 Jul 07 22:15:49 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca014a5e-b6c4-430d-a487-2cef128f173c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '37c7692b-0825-4de7-9cf1-77f9459bff87', 'volume_name': 'volume-37c7692b-0825-4de7-9cf1-77f9459bff87', 'volume_size': 1, 'image_id': 'f4170437-06d8-4d7c-a9f8-47256c81825f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4170437-06d8-4d7c-a9f8-47256c81825f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '22fdfa9c1d20b9643f867bd8a53df6d0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd0b756064794614ab4d3deb38a924d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b362e43b388f1d29246b4d22bc146aeb80b4caa2596bae27ef704ced0591e06bf4ac023ee4f6deaa3c19bc889bff357cd947e4b6cd507c63d0caf40364541bb', 'id': 'f4170437-06d8-4d7c-a9f8-47256c81825f', 'created_at': datetime.datetime(2026, 7, 7, 20, 15, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 15, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4170437-06d8-4d7c-a9f8-47256c81825f/file', 'properties': {}}, 'image_service': }' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de400e74-0ac4-4bc2-920e-5be20ec59f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de400e74-0ac4-4bc2-920e-5be20ec59f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7388da00-1f5b-41c1-a3cd-a9cc348bd1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:49 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Volume 37c7692b-0825-4de7-9cf1-77f9459bff87: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-37c7692b-0825-4de7-9cf1-77f9459bff87', 'volume_size': 1, 'image_id': 'f4170437-06d8-4d7c-a9f8-47256c81825f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4170437-06d8-4d7c-a9f8-47256c81825f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '22fdfa9c1d20b9643f867bd8a53df6d0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd0b756064794614ab4d3deb38a924d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b362e43b388f1d29246b4d22bc146aeb80b4caa2596bae27ef704ced0591e06bf4ac023ee4f6deaa3c19bc889bff357cd947e4b6cd507c63d0caf40364541bb', 'id': 'f4170437-06d8-4d7c-a9f8-47256c81825f', 'created_at': datetime.datetime(2026, 7, 7, 20, 15, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 15, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4170437-06d8-4d7c-a9f8-47256c81825f/file', 'properties': {}}, 'image_service': } Jul 07 22:15:49 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Trying to clone 37c7692b-0825-4de7-9cf1-77f9459bff87 from image f4170437-06d8-4d7c-a9f8-47256c81825f at location (None, [{'url': 'file:///opt/stack/data/glance/images/f4170437-06d8-4d7c-a9f8-47256c81825f', 'metadata': {}}]). {{(pid=87586) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 22:15:49 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 22:15:49 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Image download 0.00 MB at 0.00 MB/s Jul 07 22:15:49 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c025cd-5e0a-42a1-aea3-069aac1990e5]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:50 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD Jul 07 22:15:50 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:50 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-64698282-38ec-4c1b-a1f7-107d729c1945" returned: 0 in 0.861s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] <== create_volume: return (2129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:15:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.133s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.408s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1457859492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e16df5b-da7c-4fe0-aea0-637386971455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484acbf1ac4044348d8bd288d3754141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:46Z,use_quota=True,user_id='1726058cd1bb40c5a62b34317c8abc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:15:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Creating volume 3e16df5b-da7c-4fe0-aea0-637386971455 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:15:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:15:50 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:15:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3e16df5b-da7c-4fe0-aea0-637386971455 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:50 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3e16df5b-da7c-4fe0-aea0-637386971455 1073741824 Jul 07 22:15:50 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119d10bf-1f09-4698-883b-48023af534a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64698282-38ec-4c1b-a1f7-107d729c1945', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747336db-310d-488e-a172-8a5e30ff714e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:50 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Volume volume-64698282-38ec-4c1b-a1f7-107d729c1945 (64698282-38ec-4c1b-a1f7-107d729c1945): created successfully Jul 07 22:15:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747336db-310d-488e-a172-8a5e30ff714e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:50 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Flow 'volume_create_manager' (a7a19f67-20c3-46c8-ac3c-90b97cd0a811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:50 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ab64894b-6ab8-4702-aa1d-bb23ee90e7a2 tempest-CreateVolumesFromSnapshotTest-902813832 None] Created volume successfully. Jul 07 22:15:50 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD" returned: 0 in 0.805s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:50 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD Jul 07 22:15:50 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:51 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3e16df5b-da7c-4fe0-aea0-637386971455 1073741824" returned: 0 in 0.907s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3e16df5b-da7c-4fe0-aea0-637386971455 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:51 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3e16df5b-da7c-4fe0-aea0-637386971455 Jul 07 22:15:51 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:51 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD" returned: 1 in 0.749s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Temporary image f4170437-06d8-4d7c-a9f8-47256c81825f is fetched for user 6763a2df382c4453809551cc40a1e718. {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-76760106-f839-4632-8eea-44cc44ee58c1 tempest-ProjectAdminTests-956565646 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.693115234375, 'free_capacity_gb': 1775.693115234375, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87586) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4836}} Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c658c5-47e9-422b-9c4b-ecc818bce9d0]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:51 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD Jul 07 22:15:51 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:51 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3e16df5b-da7c-4fe0-aea0-637386971455" returned: 0 in 0.671s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.564s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-442180657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484acbf1ac4044348d8bd288d3754141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:47Z,use_quota=True,user_id='1726058cd1bb40c5a62b34317c8abc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Creating volume 5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:15:51 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:51 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7 1073741824 Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51cdbc6d-5c69-4d6e-8ee3-fe3f421bad83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e16df5b-da7c-4fe0-aea0-637386971455', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:51 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b484bd-3716-4db4-97b2-38a49f644eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:51 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Volume volume-3e16df5b-da7c-4fe0-aea0-637386971455 (3e16df5b-da7c-4fe0-aea0-637386971455): created successfully Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b484bd-3716-4db4-97b2-38a49f644eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Flow 'volume_create_manager' (810256b4-6614-49ac-be9b-ef20a0d9ff97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:51 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ca0f0a2b-448e-4a31-a00a-ba84a0388f9e tempest-CreateVolumesFromSnapshotTest-902813832 None] Created volume successfully. Jul 07 22:15:52 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD" returned: 0 in 0.832s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:52 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD Jul 07 22:15:52 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:52 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7 1073741824" returned: 0 in 0.942s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:52 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7 Jul 07 22:15:52 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:53 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD" returned: 1 in 0.885s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:15:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:53 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7" returned: 0 in 0.774s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:53 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:15:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.471s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:53 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1754412078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073f5d43-8585-40cc-963e-f93cb0ee8339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='484acbf1ac4044348d8bd288d3754141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:48Z,use_quota=True,user_id='1726058cd1bb40c5a62b34317c8abc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:15:53 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Creating volume 073f5d43-8585-40cc-963e-f93cb0ee8339 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:15:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:53 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:53 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:53 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:15:53 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:15:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-073f5d43-8585-40cc-963e-f93cb0ee8339 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1407f038-d9ad-4832-b4a3-540c4024d3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:53 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-073f5d43-8585-40cc-963e-f93cb0ee8339 1073741824 Jul 07 22:15:53 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a569998c-bc9e-433b-9d40-c65763f3b2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:53 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Volume volume-5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7 (5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7): created successfully Jul 07 22:15:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a569998c-bc9e-433b-9d40-c65763f3b2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Flow 'volume_create_manager' (c89f86fe-76f1-4cae-8586-972299916634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:53 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-59268dd9-639f-4c46-a1c9-d89db95f9b1b tempest-CreateVolumesFromSnapshotTest-902813832 None] Created volume successfully. Jul 07 22:15:54 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-073f5d43-8585-40cc-963e-f93cb0ee8339 1073741824" returned: 0 in 1.058s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-073f5d43-8585-40cc-963e-f93cb0ee8339 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:54 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-073f5d43-8585-40cc-963e-f93cb0ee8339 Jul 07 22:15:54 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:55 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-073f5d43-8585-40cc-963e-f93cb0ee8339" returned: 0 in 0.726s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:15:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.048s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c7692b-0825-4de7-9cf1-77f9459bff87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd0b756064794614ab4d3deb38a924d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:49Z,use_quota=True,user_id='6763a2df382c4453809551cc40a1e718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:15:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Creating volume 37c7692b-0825-4de7-9cf1-77f9459bff87 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:15:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:15:55 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:15:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba77684d-87c2-4d60-ac2a-4411987ee0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-073f5d43-8585-40cc-963e-f93cb0ee8339', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35887c91-2e6d-49bd-ac35-11cd84e37fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:55 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87 1073741824 Jul 07 22:15:55 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:55 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Volume volume-073f5d43-8585-40cc-963e-f93cb0ee8339 (073f5d43-8585-40cc-963e-f93cb0ee8339): created successfully Jul 07 22:15:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35887c91-2e6d-49bd-ac35-11cd84e37fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:55 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Flow 'volume_create_manager' (a68ebe89-1fe4-45d6-9613-e9e238ec74e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:55 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-7dc8b096-35b3-4c70-90c4-5f0cf3ae4c1a tempest-CreateVolumesFromSnapshotTest-902813832 None] Created volume successfully. Jul 07 22:15:56 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87 1073741824" returned: 0 in 0.981s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:56 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87 Jul 07 22:15:56 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f573cd85-b892-4835-9591-7f36eb1dc275 tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "cinder-073f5d43-8585-40cc-963e-f93cb0ee8339-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f573cd85-b892-4835-9591-7f36eb1dc275 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-073f5d43-8585-40cc-963e-f93cb0ee8339-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:56 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:15:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Flow 'volume_create_manager' (f1faae5b-fc9f-475e-8cf2-9cdac10b1ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5e353e-3618-4bb3-90dc-4dd7454d35b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5e353e-3618-4bb3-90dc-4dd7454d35b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-977737223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d7be72-ddf1-4036-a1c7-aa42e78cd972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d94796a104ca8b251257af621c466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:57Z,use_quota=True,user_id='bf6b56d5090a4d9c9d2578c8ecc98ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d97452-56f1-497a-9772-56a027df3569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d97452-56f1-497a-9772-56a027df3569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (604ee059-56f0-4495-84df-7ef7cd6c7303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (604ee059-56f0-4495-84df-7ef7cd6c7303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d7be72-ddf1-4036-a1c7-aa42e78cd972', 'volume_name': 'volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a575be22-956c-4eb8-bc44-b27667af73c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a575be22-956c-4eb8-bc44-b27667af73c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d7ec36-0fe2-4caa-8aff-e51bf3cfefd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:56 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Volume 76d7be72-ddf1-4036-a1c7-aa42e78cd972: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972', 'volume_size': 1} Jul 07 22:15:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f573cd85-b892-4835-9591-7f36eb1dc275 tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "cinder-quobyte-073f5d43-8585-40cc-963e-f93cb0ee8339" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:15:56 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f573cd85-b892-4835-9591-7f36eb1dc275 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-quobyte-073f5d43-8585-40cc-963e-f93cb0ee8339" acquired by "delete_volume" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:15:56 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8282040f-bfca-406e-b627-2f3745c70c4a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f573cd85-b892-4835-9591-7f36eb1dc275 tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-073f5d43-8585-40cc-963e-f93cb0ee8339 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:56 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-073f5d43-8585-40cc-963e-f93cb0ee8339 Jul 07 22:15:56 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:57 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87" returned: 0 in 0.798s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:15:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.413s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-977737223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d7be72-ddf1-4036-a1c7-aa42e78cd972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d94796a104ca8b251257af621c466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:15:57Z,use_quota=True,user_id='bf6b56d5090a4d9c9d2578c8ecc98ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:15:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Creating volume 76d7be72-ddf1-4036-a1c7-aa42e78cd972 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:15:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:57 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:15:57 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:15:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:57 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972 1073741824 Jul 07 22:15:57 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:57 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Attempting download of f4170437-06d8-4d7c-a9f8-47256c81825f ((None, [{'url': 'file:///opt/stack/data/glance/images/f4170437-06d8-4d7c-a9f8-47256c81825f', 'metadata': {}}])) to volume 37c7692b-0825-4de7-9cf1-77f9459bff87. {{(pid=87586) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 22:15:57 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89f754f-f0d5-4160-bf49-412bf795a439]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4170437-06d8-4d7c-a9f8-47256c81825f_nv38932v {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:57 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4170437-06d8-4d7c-a9f8-47256c81825f_nv38932v Jul 07 22:15:57 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:57 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f573cd85-b892-4835-9591-7f36eb1dc275 tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-073f5d43-8585-40cc-963e-f93cb0ee8339" returned: 0 in 0.977s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f573cd85-b892-4835-9591-7f36eb1dc275 tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-073f5d43-8585-40cc-963e-f93cb0ee8339 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:57 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-073f5d43-8585-40cc-963e-f93cb0ee8339 Jul 07 22:15:57 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:58 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f4170437-06d8-4d7c-a9f8-47256c81825f_nv38932v" returned: 0 in 0.872s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4170437-06d8-4d7c-a9f8-47256c81825f_nv38932v {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:58 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972 1073741824" returned: 0 in 1.027s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:58 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:UPDATE=193,cinder:SELECT=132,cinder:DELETE=14,cinder:INSERT=41 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:15:58 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=138,cinder:UPDATE=178,cinder:INSERT=52,cinder:DELETE=22 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:15:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:58 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972 Jul 07 22:15:58 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:58 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4170437-06d8-4d7c-a9f8-47256c81825f_nv38932v Jul 07 22:15:58 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:58 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f573cd85-b892-4835-9591-7f36eb1dc275 tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-073f5d43-8585-40cc-963e-f93cb0ee8339" returned: 0 in 0.912s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:58 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f573cd85-b892-4835-9591-7f36eb1dc275 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-quobyte-073f5d43-8585-40cc-963e-f93cb0ee8339" released by "delete_volume" :: held 1.946s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:58 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-f573cd85-b892-4835-9591-7f36eb1dc275 tempest-CreateVolumesFromSnapshotTest-902813832 None] Created reservations ['6a6db0b4-0bd5-4707-a23c-5bfbfa2bfd6d', '10a3b9fc-fc05-4e9a-bcbf-cdb2da4a5816', '80dc78d0-eb5b-4341-bb82-63b085a696d2', '548bd5d8-a12b-4882-924f-7f6ff3a7ee45'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:15:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f573cd85-b892-4835-9591-7f36eb1dc275 tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:15:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f573cd85-b892-4835-9591-7f36eb1dc275 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:15:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f573cd85-b892-4835-9591-7f36eb1dc275 tempest-CreateVolumesFromSnapshotTest-902813832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:15:58 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f573cd85-b892-4835-9591-7f36eb1dc275 tempest-CreateVolumesFromSnapshotTest-902813832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:15:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f573cd85-b892-4835-9591-7f36eb1dc275 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f573cd85-b892-4835-9591-7f36eb1dc275 tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:58 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:15:58 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:58 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4170437-06d8-4d7c-a9f8-47256c81825f_nv38932v" returned: 1 in 0.763s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f4170437-06d8-4d7c-a9f8-47256c81825f_nv38932v' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:15:58 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[78187a35-082d-457f-b909-15cae3cde91e]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:15:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:59 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972" returned: 0 in 0.699s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:15:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:15:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d7ec36-0fe2-4caa-8aff-e51bf3cfefd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7199b49c-4cb7-43ea-ac44-30e57e5f022c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:15:59 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Volume volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972 (76d7be72-ddf1-4036-a1c7-aa42e78cd972): created successfully Jul 07 22:15:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7199b49c-4cb7-43ea-ac44-30e57e5f022c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:15:59 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Flow 'volume_create_manager' (f1faae5b-fc9f-475e-8cf2-9cdac10b1ac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:15:59 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ac1d277f-9495-435c-9867-f0a1f52a4d6d tempest-ProjectReaderTests-302102808 None] Created volume successfully. Jul 07 22:15:59 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD Jul 07 22:15:59 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:15:59 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f573cd85-b892-4835-9591-7f36eb1dc275 tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.809s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:59 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-f573cd85-b892-4835-9591-7f36eb1dc275 tempest-CreateVolumesFromSnapshotTest-902813832 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:15:59 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-f573cd85-b892-4835-9591-7f36eb1dc275 tempest-CreateVolumesFromSnapshotTest-902813832 None] Deleted volume successfully. Jul 07 22:15:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f573cd85-b892-4835-9591-7f36eb1dc275 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-073f5d43-8585-40cc-963e-f93cb0ee8339-delete_volume" released by "delete_volume" :: held 3.126s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:15:59 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jul 07 22:15:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD" returned: 0 in 0.815s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:15:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:15:59 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD Jul 07 22:15:59 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0e65e873-b1e2-4859-b097-90b3819415dc tempest-ProjectReaderTests-302102808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0e65e873-b1e2-4859-b097-90b3819415dc tempest-ProjectReaderTests-302102808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-0e65e873-b1e2-4859-b097-90b3819415dc tempest-ProjectReaderTests-302102808 None] Creating offline snapshot db586162-6c80-47e0-be0b-af346478884d of volume 76d7be72-ddf1-4036-a1c7-aa42e78cd972 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:16:00 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-df30e6b2-19b8-497d-87ff-fc8c0a00ec90 tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "cinder-5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:00 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[00babaa9-50c1-4693-92f5-feac0c1e3c53]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0e65e873-b1e2-4859-b097-90b3819415dc tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:00 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-df30e6b2-19b8-497d-87ff-fc8c0a00ec90 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:00 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-df30e6b2-19b8-497d-87ff-fc8c0a00ec90 tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "cinder-quobyte-5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:00 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-df30e6b2-19b8-497d-87ff-fc8c0a00ec90 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-quobyte-5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7" acquired by "delete_volume" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:00 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb52c72-54ae-4342-a746-4384f4eaf039]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-df30e6b2-19b8-497d-87ff-fc8c0a00ec90 tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:00 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972 Jul 07 22:16:00 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:00 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7 Jul 07 22:16:00 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:00 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD" returned: 1 in 0.919s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:16:00 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] f4170437-06d8-4d7c-a9f8-47256c81825f was raw, converting to raw {{(pid=87586) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 22:16:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:00 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87 Jul 07 22:16:00 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:01 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0e65e873-b1e2-4859-b097-90b3819415dc tempest-ProjectReaderTests-302102808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972" returned: 0 in 0.910s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0e65e873-b1e2-4859-b097-90b3819415dc tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.db586162-6c80-47e0-be0b-af346478884d 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:01 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.db586162-6c80-47e0-be0b-af346478884d 1G Jul 07 22:16:01 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:01 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-df30e6b2-19b8-497d-87ff-fc8c0a00ec90 tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7" returned: 0 in 0.922s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-df30e6b2-19b8-497d-87ff-fc8c0a00ec90 tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:01 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7 Jul 07 22:16:01 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:01 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87" returned: 0 in 0.984s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:01 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f4170437-06d8-4d7c-a9f8-47256c81825f_455bcg5cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87 {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:16:01 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 22:16:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:01 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87 1G Jul 07 22:16:01 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:02 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0e65e873-b1e2-4859-b097-90b3819415dc tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.db586162-6c80-47e0-be0b-af346478884d 1G" returned: 0 in 0.935s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0e65e873-b1e2-4859-b097-90b3819415dc tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.db586162-6c80-47e0-be0b-af346478884d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:02 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.db586162-6c80-47e0-be0b-af346478884d Jul 07 22:16:02 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:02 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-df30e6b2-19b8-497d-87ff-fc8c0a00ec90 tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7" returned: 0 in 0.809s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-df30e6b2-19b8-497d-87ff-fc8c0a00ec90 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-quobyte-5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7" released by "delete_volume" :: held 1.784s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:02 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-df30e6b2-19b8-497d-87ff-fc8c0a00ec90 tempest-CreateVolumesFromSnapshotTest-902813832 None] Created reservations ['f8474b00-2d30-4ebb-a706-d96d25215aaf', '4a69786b-75f8-45ad-8b81-7ce2c3d960ae', '5ebc8b28-da6a-42ac-be49-0424d32699a1', '35e33f00-e3b0-4352-820d-87e799b54635'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-df30e6b2-19b8-497d-87ff-fc8c0a00ec90 tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-df30e6b2-19b8-497d-87ff-fc8c0a00ec90 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-df30e6b2-19b8-497d-87ff-fc8c0a00ec90 tempest-CreateVolumesFromSnapshotTest-902813832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-df30e6b2-19b8-497d-87ff-fc8c0a00ec90 tempest-CreateVolumesFromSnapshotTest-902813832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-df30e6b2-19b8-497d-87ff-fc8c0a00ec90 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-df30e6b2-19b8-497d-87ff-fc8c0a00ec90 tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:02 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:16:02 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a0c44d07-c4e6-4765-aeda-a979bbce675a tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "cinder-3e16df5b-da7c-4fe0-aea0-637386971455-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a0c44d07-c4e6-4765-aeda-a979bbce675a tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-3e16df5b-da7c-4fe0-aea0-637386971455-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:02 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a0c44d07-c4e6-4765-aeda-a979bbce675a tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "cinder-quobyte-3e16df5b-da7c-4fe0-aea0-637386971455" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87 1G" returned: 0 in 0.961s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a0c44d07-c4e6-4765-aeda-a979bbce675a tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-quobyte-3e16df5b-da7c-4fe0-aea0-637386971455" acquired by "delete_volume" :: waited 0.023s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:02 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93eed0e-dbf1-4a86-9e7b-01d199959173]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:02 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba86fd8-12a6-4905-9a6b-b7946ba2742d]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a0c44d07-c4e6-4765-aeda-a979bbce675a tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3e16df5b-da7c-4fe0-aea0-637386971455 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:02 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3e16df5b-da7c-4fe0-aea0-637386971455 Jul 07 22:16:02 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:02 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87 Jul 07 22:16:02 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:03 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0e65e873-b1e2-4859-b097-90b3819415dc tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.db586162-6c80-47e0-be0b-af346478884d" returned: 0 in 0.904s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:03 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-0e65e873-b1e2-4859-b097-90b3819415dc tempest-ProjectReaderTests-302102808 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.db586162-6c80-47e0-be0b-af346478884d is being set with open permissions: ugo+rw Jul 07 22:16:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0e65e873-b1e2-4859-b097-90b3819415dc tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.db586162-6c80-47e0-be0b-af346478884d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:03 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.db586162-6c80-47e0-be0b-af346478884d Jul 07 22:16:03 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:03 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-df30e6b2-19b8-497d-87ff-fc8c0a00ec90 tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.064s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:03 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-df30e6b2-19b8-497d-87ff-fc8c0a00ec90 tempest-CreateVolumesFromSnapshotTest-902813832 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:16:03 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-df30e6b2-19b8-497d-87ff-fc8c0a00ec90 tempest-CreateVolumesFromSnapshotTest-902813832 None] Deleted volume successfully. Jul 07 22:16:03 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-df30e6b2-19b8-497d-87ff-fc8c0a00ec90 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-5a95a499-fb20-4aea-bbb4-e0a7ed4fb6e7-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:03 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87" returned: 0 in 1.114s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:03 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a0c44d07-c4e6-4765-aeda-a979bbce675a tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3e16df5b-da7c-4fe0-aea0-637386971455" returned: 0 in 1.166s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a0c44d07-c4e6-4765-aeda-a979bbce675a tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3e16df5b-da7c-4fe0-aea0-637386971455 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:03 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3e16df5b-da7c-4fe0-aea0-637386971455 Jul 07 22:16:03 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:03 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87 Jul 07 22:16:03 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:04 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0e65e873-b1e2-4859-b097-90b3819415dc tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.db586162-6c80-47e0-be0b-af346478884d" returned: 0 in 1.154s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0e65e873-b1e2-4859-b097-90b3819415dc tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:04 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.info Jul 07 22:16:04 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:04 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a0c44d07-c4e6-4765-aeda-a979bbce675a tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3e16df5b-da7c-4fe0-aea0-637386971455" returned: 0 in 0.848s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:04 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87" returned: 1 in 0.942s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:16:04 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Downloaded image f4170437-06d8-4d7c-a9f8-47256c81825f ((None, [{'url': 'file:///opt/stack/data/glance/images/f4170437-06d8-4d7c-a9f8-47256c81825f', 'metadata': {}}])) to volume 37c7692b-0825-4de7-9cf1-77f9459bff87 successfully. {{(pid=87586) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 22:16:04 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Temporary image f4170437-06d8-4d7c-a9f8-47256c81825f for user 6763a2df382c4453809551cc40a1e718 is deleted. {{(pid=87586) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 22:16:04 devstack cinder-volume[87586]: DEBUG cinder.volume.volume_utils [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Marking volume 37c7692b-0825-4de7-9cf1-77f9459bff87 as bootable. {{(pid=87586) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 22:16:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a0c44d07-c4e6-4765-aeda-a979bbce675a tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-quobyte-3e16df5b-da7c-4fe0-aea0-637386971455" released by "delete_volume" :: held 2.102s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:04 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Copying metadata from image f4170437-06d8-4d7c-a9f8-47256c81825f to 37c7692b-0825-4de7-9cf1-77f9459bff87. {{(pid=87586) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 22:16:04 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Creating volume glance metadata for volume 37c7692b-0825-4de7-9cf1-77f9459bff87 backed by image f4170437-06d8-4d7c-a9f8-47256c81825f with: {'image_id': 'f4170437-06d8-4d7c-a9f8-47256c81825f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '22fdfa9c1d20b9643f867bd8a53df6d0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87586) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 22:16:04 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-a0c44d07-c4e6-4765-aeda-a979bbce675a tempest-CreateVolumesFromSnapshotTest-902813832 None] Created reservations ['d5dee9c4-f836-437f-be37-f710a3676e96', 'e899e7a7-f42f-409c-a8c1-324482c89f1e', 'fcafad80-8622-4ab0-9f94-7dbf202b81ed', '6aa2e7ec-a14a-4916-86c8-871704ced688'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7388da00-1f5b-41c1-a3cd-a9cc348bd1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37c7692b-0825-4de7-9cf1-77f9459bff87', 'volume_size': 1, 'image_id': 'f4170437-06d8-4d7c-a9f8-47256c81825f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f4170437-06d8-4d7c-a9f8-47256c81825f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '22fdfa9c1d20b9643f867bd8a53df6d0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd0b756064794614ab4d3deb38a924d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b362e43b388f1d29246b4d22bc146aeb80b4caa2596bae27ef704ced0591e06bf4ac023ee4f6deaa3c19bc889bff357cd947e4b6cd507c63d0caf40364541bb', 'id': 'f4170437-06d8-4d7c-a9f8-47256c81825f', 'created_at': datetime.datetime(2026, 7, 7, 20, 15, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 15, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f4170437-06d8-4d7c-a9f8-47256c81825f/file', 'properties': {}}, 'image_service': }' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23cbae5-d9e8-4ce2-b758-53501d8a679c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:04 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Volume volume-37c7692b-0825-4de7-9cf1-77f9459bff87 (37c7692b-0825-4de7-9cf1-77f9459bff87): created successfully Jul 07 22:16:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23cbae5-d9e8-4ce2-b758-53501d8a679c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:04 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Flow 'volume_create_manager' (5bd64048-0a02-4e44-a321-75a0647e07aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:05 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-0440e4ee-21a7-434a-8d97-cce475ceea57 tempest-VolumeImageDependencyTests-1911095623 None] Created volume successfully. Jul 07 22:16:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a0c44d07-c4e6-4765-aeda-a979bbce675a tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a0c44d07-c4e6-4765-aeda-a979bbce675a tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:05 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a0c44d07-c4e6-4765-aeda-a979bbce675a tempest-CreateVolumesFromSnapshotTest-902813832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:05 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a0c44d07-c4e6-4765-aeda-a979bbce675a tempest-CreateVolumesFromSnapshotTest-902813832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a0c44d07-c4e6-4765-aeda-a979bbce675a tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a0c44d07-c4e6-4765-aeda-a979bbce675a tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:05 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:16:05 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:05 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0e65e873-b1e2-4859-b097-90b3819415dc tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.info" returned: 0 in 0.860s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:05 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-0e65e873-b1e2-4859-b097-90b3819415dc tempest-ProjectReaderTests-302102808 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.info is being set with open permissions: ugo+rw Jul 07 22:16:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0e65e873-b1e2-4859-b097-90b3819415dc tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:05 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.info Jul 07 22:16:05 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:05 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] Acquiring lock "cinder-37c7692b-0825-4de7-9cf1-77f9459bff87-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:05 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] Lock "cinder-37c7692b-0825-4de7-9cf1-77f9459bff87-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:05 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] Acquiring lock "cinder-quobyte-37c7692b-0825-4de7-9cf1-77f9459bff87" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:05 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] Lock "cinder-quobyte-37c7692b-0825-4de7-9cf1-77f9459bff87" acquired by "delete_volume" :: waited 0.026s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:05 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c96904-0135-4ea1-af61-e5b9929fb17b]: (4, 'raw') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:05 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a0c44d07-c4e6-4765-aeda-a979bbce675a tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.765s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:05 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-a0c44d07-c4e6-4765-aeda-a979bbce675a tempest-CreateVolumesFromSnapshotTest-902813832 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:16:05 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-a0c44d07-c4e6-4765-aeda-a979bbce675a tempest-CreateVolumesFromSnapshotTest-902813832 None] Deleted volume successfully. Jul 07 22:16:05 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-a0c44d07-c4e6-4765-aeda-a979bbce675a tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-3e16df5b-da7c-4fe0-aea0-637386971455-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:05 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87 Jul 07 22:16:05 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:05 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5fb42bc2-c2d7-4ad6-83a3-5750ce4e5c4c tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "cinder-64698282-38ec-4c1b-a1f7-107d729c1945-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:05 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0e65e873-b1e2-4859-b097-90b3819415dc tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.info" returned: 0 in 0.867s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0e65e873-b1e2-4859-b097-90b3819415dc tempest-ProjectReaderTests-302102808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.801s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:06 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5fb42bc2-c2d7-4ad6-83a3-5750ce4e5c4c tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-64698282-38ec-4c1b-a1f7-107d729c1945-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:06 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-0e65e873-b1e2-4859-b097-90b3819415dc tempest-ProjectReaderTests-302102808 None] Create snapshot completed successfully Jul 07 22:16:06 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5fb42bc2-c2d7-4ad6-83a3-5750ce4e5c4c tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "cinder-quobyte-64698282-38ec-4c1b-a1f7-107d729c1945" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:06 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5fb42bc2-c2d7-4ad6-83a3-5750ce4e5c4c tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-quobyte-64698282-38ec-4c1b-a1f7-107d729c1945" acquired by "delete_volume" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:06 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a49e6dc-a2e5-4ed6-8ecb-51d1be6746ed]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5fb42bc2-c2d7-4ad6-83a3-5750ce4e5c4c tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-64698282-38ec-4c1b-a1f7-107d729c1945 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:06 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-64698282-38ec-4c1b-a1f7-107d729c1945 Jul 07 22:16:06 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:06 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87" returned: 0 in 0.988s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:06 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-74975ca3-a988-4a7d-bb24-19ed14c533c5 tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-db586162-6c80-47e0-be0b-af346478884d-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:06 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-74975ca3-a988-4a7d-bb24-19ed14c533c5 tempest-ProjectReaderTests-302102808 None] Lock "cinder-db586162-6c80-47e0-be0b-af346478884d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:06 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-74975ca3-a988-4a7d-bb24-19ed14c533c5 tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-quobyte-76d7be72-ddf1-4036-a1c7-aa42e78cd972" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:06 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-74975ca3-a988-4a7d-bb24-19ed14c533c5 tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-76d7be72-ddf1-4036-a1c7-aa42e78cd972" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:06 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-74975ca3-a988-4a7d-bb24-19ed14c533c5 tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-quobyte-db586162-6c80-47e0-be0b-af346478884d" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:06 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-74975ca3-a988-4a7d-bb24-19ed14c533c5 tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-db586162-6c80-47e0-be0b-af346478884d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-74975ca3-a988-4a7d-bb24-19ed14c533c5 tempest-ProjectReaderTests-302102808 None] Deleting offline snapshot db586162-6c80-47e0-be0b-af346478884d of volume 76d7be72-ddf1-4036-a1c7-aa42e78cd972 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:16:06 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87 Jul 07 22:16:06 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:06 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-74975ca3-a988-4a7d-bb24-19ed14c533c5 tempest-ProjectReaderTests-302102808 None] snapshot_file for this snap is: volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.db586162-6c80-47e0-be0b-af346478884d {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:16:06 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee814c53-df86-4f2d-a3ff-202caf3daa9a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-74975ca3-a988-4a7d-bb24-19ed14c533c5 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.db586162-6c80-47e0-be0b-af346478884d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:07 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5fb42bc2-c2d7-4ad6-83a3-5750ce4e5c4c tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-64698282-38ec-4c1b-a1f7-107d729c1945" returned: 0 in 0.946s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5fb42bc2-c2d7-4ad6-83a3-5750ce4e5c4c tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-64698282-38ec-4c1b-a1f7-107d729c1945 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:07 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-64698282-38ec-4c1b-a1f7-107d729c1945 Jul 07 22:16:07 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:07 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.db586162-6c80-47e0-be0b-af346478884d Jul 07 22:16:07 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Flow 'volume_create_manager' (281cafad-ff37-4537-84d0-f721557fd25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a31c52-8c59-4db9-93f5-299a4bd4025f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a31c52-8c59-4db9-93f5-299a4bd4025f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1966025690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccfb5069-9598-4778-9662-3f52f68b95d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='382aa079cf4945d1ae79f19ee7d5388b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:07Z,use_quota=True,user_id='1b646148df8049c2bff812fecc573bfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc67ef4-0087-42f1-ad57-3ce2cc569ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc67ef4-0087-42f1-ad57-3ce2cc569ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b825280-7358-462d-a288-9243eceb1b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b825280-7358-462d-a288-9243eceb1b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccfb5069-9598-4778-9662-3f52f68b95d0', 'volume_name': 'volume-ccfb5069-9598-4778-9662-3f52f68b95d0', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0dac6d8-a8e2-4fc3-a846-c414471579a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0dac6d8-a8e2-4fc3-a846-c414471579a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d95ce7f-9e91-432f-94b4-a016bbe02a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:07 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Volume ccfb5069-9598-4778-9662-3f52f68b95d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccfb5069-9598-4778-9662-3f52f68b95d0', 'volume_size': 1} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1966025690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccfb5069-9598-4778-9662-3f52f68b95d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='382aa079cf4945d1ae79f19ee7d5388b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:07Z,use_quota=True,user_id='1b646148df8049c2bff812fecc573bfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Creating volume ccfb5069-9598-4778-9662-3f52f68b95d0 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:16:07 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ccfb5069-9598-4778-9662-3f52f68b95d0 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:07 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ccfb5069-9598-4778-9662-3f52f68b95d0 1073741824 Jul 07 22:16:07 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:07 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87" returned: 1 in 0.949s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87' failed. Not Retrying. {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:07 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87 Jul 07 22:16:07 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:07 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-74975ca3-a988-4a7d-bb24-19ed14c533c5 tempest-ProjectReaderTests-302102808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.db586162-6c80-47e0-be0b-af346478884d" returned: 0 in 0.963s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-74975ca3-a988-4a7d-bb24-19ed14c533c5 tempest-ProjectReaderTests-302102808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:16:07 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5fb42bc2-c2d7-4ad6-83a3-5750ce4e5c4c tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-64698282-38ec-4c1b-a1f7-107d729c1945" returned: 0 in 0.890s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5fb42bc2-c2d7-4ad6-83a3-5750ce4e5c4c tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-quobyte-64698282-38ec-4c1b-a1f7-107d729c1945" released by "delete_volume" :: held 1.872s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7264354-71d0-4374-afef-29b522176162]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-74975ca3-a988-4a7d-bb24-19ed14c533c5 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-5fb42bc2-c2d7-4ad6-83a3-5750ce4e5c4c tempest-CreateVolumesFromSnapshotTest-902813832 None] Created reservations ['a08fc8e3-10a4-4367-bf3c-6f538a368dad', 'a999657b-c3c1-4c3b-ab92-fa48a51751d2', 'c697b0aa-b26b-4f2b-a911-92fc7232dc0c', 'e3e1e2c7-b7ea-4cfe-b22b-9bb35874165a'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:08 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972 Jul 07 22:16:08 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5fb42bc2-c2d7-4ad6-83a3-5750ce4e5c4c tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5fb42bc2-c2d7-4ad6-83a3-5750ce4e5c4c tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5fb42bc2-c2d7-4ad6-83a3-5750ce4e5c4c tempest-CreateVolumesFromSnapshotTest-902813832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5fb42bc2-c2d7-4ad6-83a3-5750ce4e5c4c tempest-CreateVolumesFromSnapshotTest-902813832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5fb42bc2-c2d7-4ad6-83a3-5750ce4e5c4c tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5fb42bc2-c2d7-4ad6-83a3-5750ce4e5c4c tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:08 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:16:08 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-992cd5fa-089b-43af-a221-5a25b90e19fb tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "cinder-b3f12c4f-3ba0-4893-8802-555e1a56997d-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-992cd5fa-089b-43af-a221-5a25b90e19fb tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-b3f12c4f-3ba0-4893-8802-555e1a56997d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-992cd5fa-089b-43af-a221-5a25b90e19fb tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "cinder-quobyte-b3f12c4f-3ba0-4893-8802-555e1a56997d" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-992cd5fa-089b-43af-a221-5a25b90e19fb tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-quobyte-b3f12c4f-3ba0-4893-8802-555e1a56997d" acquired by "delete_volume" :: waited 0.032s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d261fe9a-a985-4d94-aced-b1460400ea1c]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992cd5fa-089b-43af-a221-5a25b90e19fb tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b3f12c4f-3ba0-4893-8802-555e1a56997d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:08 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ccfb5069-9598-4778-9662-3f52f68b95d0 1073741824" returned: 0 in 1.067s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:08 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-37c7692b-0825-4de7-9cf1-77f9459bff87" returned: 0 in 0.834s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] Lock "cinder-quobyte-37c7692b-0825-4de7-9cf1-77f9459bff87" released by "delete_volume" :: held 2.857s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ccfb5069-9598-4778-9662-3f52f68b95d0 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:08 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b3f12c4f-3ba0-4893-8802-555e1a56997d Jul 07 22:16:08 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:08 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ccfb5069-9598-4778-9662-3f52f68b95d0 Jul 07 22:16:08 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] Created reservations ['3f689312-3808-4237-a3b8-cf13da289b4a', 'cc343458-54a5-4823-aa61-65b9006157cd', 'e5276165-4e79-4510-b60e-68c7986cc9f9', 'c643eaef-bf1e-41ef-b324-d287c17eb598'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:08 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:16:08 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:09 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-74975ca3-a988-4a7d-bb24-19ed14c533c5 tempest-ProjectReaderTests-302102808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972" returned: 0 in 1.132s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-74975ca3-a988-4a7d-bb24-19ed14c533c5 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.db586162-6c80-47e0-be0b-af346478884d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:09 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.db586162-6c80-47e0-be0b-af346478884d Jul 07 22:16:09 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:09 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5fb42bc2-c2d7-4ad6-83a3-5750ce4e5c4c tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.217s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:09 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-5fb42bc2-c2d7-4ad6-83a3-5750ce4e5c4c tempest-CreateVolumesFromSnapshotTest-902813832 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:16:09 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-5fb42bc2-c2d7-4ad6-83a3-5750ce4e5c4c tempest-CreateVolumesFromSnapshotTest-902813832 None] Deleted volume successfully. Jul 07 22:16:09 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5fb42bc2-c2d7-4ad6-83a3-5750ce4e5c4c tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-64698282-38ec-4c1b-a1f7-107d729c1945-delete_volume" released by "delete_volume" :: held 3.367s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:09 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ccfb5069-9598-4778-9662-3f52f68b95d0" returned: 0 in 1.047s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] <== create_volume: return (2195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:16:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.198s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d95ce7f-9e91-432f-94b4-a016bbe02a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccfb5069-9598-4778-9662-3f52f68b95d0', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be45fe41-081e-4df9-83b6-7c74176ac411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:09 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.925s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:09 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:16:09 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] Deleted volume successfully. Jul 07 22:16:09 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Volume volume-ccfb5069-9598-4778-9662-3f52f68b95d0 (ccfb5069-9598-4778-9662-3f52f68b95d0): created successfully Jul 07 22:16:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be45fe41-081e-4df9-83b6-7c74176ac411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Flow 'volume_create_manager' (281cafad-ff37-4537-84d0-f721557fd25b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:09 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-272acbe4-a1ba-4ac9-94b5-e7dddff5efdf tempest-ProjectReaderTests-1018166429 None] Created volume successfully. Jul 07 22:16:09 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8372cc8f-f95e-4ea0-9fc0-7f542c12c55d tempest-VolumeImageDependencyTests-1911095623 None] Lock "cinder-37c7692b-0825-4de7-9cf1-77f9459bff87-delete_volume" released by "delete_volume" :: held 4.153s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:09 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992cd5fa-089b-43af-a221-5a25b90e19fb tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b3f12c4f-3ba0-4893-8802-555e1a56997d" returned: 0 in 1.281s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992cd5fa-089b-43af-a221-5a25b90e19fb tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b3f12c4f-3ba0-4893-8802-555e1a56997d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:09 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b3f12c4f-3ba0-4893-8802-555e1a56997d Jul 07 22:16:09 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:10 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-74975ca3-a988-4a7d-bb24-19ed14c533c5 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.db586162-6c80-47e0-be0b-af346478884d" returned: 0 in 0.989s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-74975ca3-a988-4a7d-bb24-19ed14c533c5 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.db586162-6c80-47e0-be0b-af346478884d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:10 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.db586162-6c80-47e0-be0b-af346478884d Jul 07 22:16:10 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:10 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992cd5fa-089b-43af-a221-5a25b90e19fb tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b3f12c4f-3ba0-4893-8802-555e1a56997d" returned: 0 in 0.736s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:10 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-992cd5fa-089b-43af-a221-5a25b90e19fb tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-quobyte-b3f12c4f-3ba0-4893-8802-555e1a56997d" released by "delete_volume" :: held 2.075s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:10 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-992cd5fa-089b-43af-a221-5a25b90e19fb tempest-CreateVolumesFromSnapshotTest-902813832 None] Created reservations ['b9242f13-975f-4f43-9714-6e81c39fb285', '18dfbe10-f793-431e-b02b-ba5089625007', 'f1607182-4a62-4f42-8ebf-7a88f1988172', '21607ae7-1408-4fd7-b1b0-7926ecd3f8f6'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-992cd5fa-089b-43af-a221-5a25b90e19fb tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-992cd5fa-089b-43af-a221-5a25b90e19fb tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-992cd5fa-089b-43af-a221-5a25b90e19fb tempest-CreateVolumesFromSnapshotTest-902813832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-992cd5fa-089b-43af-a221-5a25b90e19fb tempest-CreateVolumesFromSnapshotTest-902813832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-992cd5fa-089b-43af-a221-5a25b90e19fb tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992cd5fa-089b-43af-a221-5a25b90e19fb tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:10 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:16:10 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:10 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-74975ca3-a988-4a7d-bb24-19ed14c533c5 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972.db586162-6c80-47e0-be0b-af346478884d" returned: 0 in 0.751s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:10 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-74975ca3-a988-4a7d-bb24-19ed14c533c5 tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-db586162-6c80-47e0-be0b-af346478884d" released by "_delete_snapshot" :: held 3.983s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:10 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-74975ca3-a988-4a7d-bb24-19ed14c533c5 tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-76d7be72-ddf1-4036-a1c7-aa42e78cd972" released by "delete_snapshot" :: held 4.019s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:10 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9e563d11-b896-4ae0-8b59-07bbfeb205a5 tempest-ProjectReaderTests-1018166429 None] Acquiring lock "cinder-ccfb5069-9598-4778-9662-3f52f68b95d0-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9e563d11-b896-4ae0-8b59-07bbfeb205a5 tempest-ProjectReaderTests-1018166429 None] Lock "cinder-ccfb5069-9598-4778-9662-3f52f68b95d0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-74975ca3-a988-4a7d-bb24-19ed14c533c5 tempest-ProjectReaderTests-302102808 None] Created reservations ['51c0fd23-15ba-4a67-a8bb-2da660f73e5a', '5435cfc5-9177-4481-a28f-a537b931c9c1', '81159742-b4b4-432c-b16a-6dd59d8a06f6', '1c0b4e92-a326-4f67-8de6-c52f254783f0'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9e563d11-b896-4ae0-8b59-07bbfeb205a5 tempest-ProjectReaderTests-1018166429 None] Acquiring lock "cinder-quobyte-ccfb5069-9598-4778-9662-3f52f68b95d0" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9e563d11-b896-4ae0-8b59-07bbfeb205a5 tempest-ProjectReaderTests-1018166429 None] Lock "cinder-quobyte-ccfb5069-9598-4778-9662-3f52f68b95d0" acquired by "delete_volume" :: waited 0.041s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[000727c9-3605-4a6e-823a-ea2fe716efbb]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9e563d11-b896-4ae0-8b59-07bbfeb205a5 tempest-ProjectReaderTests-1018166429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ccfb5069-9598-4778-9662-3f52f68b95d0 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:11 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-74975ca3-a988-4a7d-bb24-19ed14c533c5 tempest-ProjectReaderTests-302102808 None] Delete snapshot completed successfully. Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-74975ca3-a988-4a7d-bb24-19ed14c533c5 tempest-ProjectReaderTests-302102808 None] Lock "cinder-db586162-6c80-47e0-be0b-af346478884d-delete_snapshot" released by "delete_snapshot" :: held 4.287s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8f766a14-c6a4-4933-8068-c7f2dcbcc489 tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-76d7be72-ddf1-4036-a1c7-aa42e78cd972-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8f766a14-c6a4-4933-8068-c7f2dcbcc489 tempest-ProjectReaderTests-302102808 None] Lock "cinder-76d7be72-ddf1-4036-a1c7-aa42e78cd972-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:11 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ccfb5069-9598-4778-9662-3f52f68b95d0 Jul 07 22:16:11 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8f766a14-c6a4-4933-8068-c7f2dcbcc489 tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-quobyte-76d7be72-ddf1-4036-a1c7-aa42e78cd972" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8f766a14-c6a4-4933-8068-c7f2dcbcc489 tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-76d7be72-ddf1-4036-a1c7-aa42e78cd972" acquired by "delete_volume" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd91317-a490-4c51-83d4-81e524ca11e8]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8f766a14-c6a4-4933-8068-c7f2dcbcc489 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:11 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972 Jul 07 22:16:11 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:11 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-992cd5fa-089b-43af-a221-5a25b90e19fb tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.882s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-992cd5fa-089b-43af-a221-5a25b90e19fb tempest-CreateVolumesFromSnapshotTest-902813832 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:16:11 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-992cd5fa-089b-43af-a221-5a25b90e19fb tempest-CreateVolumesFromSnapshotTest-902813832 None] Deleted volume successfully. Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-992cd5fa-089b-43af-a221-5a25b90e19fb tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-b3f12c4f-3ba0-4893-8802-555e1a56997d-delete_volume" released by "delete_volume" :: held 3.281s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-832d2c2a-ee58-4984-8ab5-dacc0d07192b tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "cinder-e03fc7bb-aaee-4046-b8ce-097f9c11f9da-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-832d2c2a-ee58-4984-8ab5-dacc0d07192b tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-e03fc7bb-aaee-4046-b8ce-097f9c11f9da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-832d2c2a-ee58-4984-8ab5-dacc0d07192b tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "cinder-quobyte-e44818ea-83ad-4e7f-a312-dcd0f8e6576b" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-832d2c2a-ee58-4984-8ab5-dacc0d07192b tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-quobyte-e44818ea-83ad-4e7f-a312-dcd0f8e6576b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-832d2c2a-ee58-4984-8ab5-dacc0d07192b tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "cinder-quobyte-e03fc7bb-aaee-4046-b8ce-097f9c11f9da" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-832d2c2a-ee58-4984-8ab5-dacc0d07192b tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-quobyte-e03fc7bb-aaee-4046-b8ce-097f9c11f9da" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-832d2c2a-ee58-4984-8ab5-dacc0d07192b tempest-CreateVolumesFromSnapshotTest-902813832 None] Deleting offline snapshot e03fc7bb-aaee-4046-b8ce-097f9c11f9da of volume e44818ea-83ad-4e7f-a312-dcd0f8e6576b {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-832d2c2a-ee58-4984-8ab5-dacc0d07192b tempest-CreateVolumesFromSnapshotTest-902813832 None] snapshot_file for this snap is: volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.e03fc7bb-aaee-4046-b8ce-097f9c11f9da {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6038040a-590f-4f9a-b260-9cfc8aa8a95f]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-832d2c2a-ee58-4984-8ab5-dacc0d07192b tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.e03fc7bb-aaee-4046-b8ce-097f9c11f9da {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:11 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.e03fc7bb-aaee-4046-b8ce-097f9c11f9da Jul 07 22:16:11 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:12 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9e563d11-b896-4ae0-8b59-07bbfeb205a5 tempest-ProjectReaderTests-1018166429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ccfb5069-9598-4778-9662-3f52f68b95d0" returned: 0 in 0.978s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9e563d11-b896-4ae0-8b59-07bbfeb205a5 tempest-ProjectReaderTests-1018166429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ccfb5069-9598-4778-9662-3f52f68b95d0 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:12 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ccfb5069-9598-4778-9662-3f52f68b95d0 Jul 07 22:16:12 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:12 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8f766a14-c6a4-4933-8068-c7f2dcbcc489 tempest-ProjectReaderTests-302102808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972" returned: 0 in 0.918s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8f766a14-c6a4-4933-8068-c7f2dcbcc489 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:12 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972 Jul 07 22:16:12 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:12 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-832d2c2a-ee58-4984-8ab5-dacc0d07192b tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.e03fc7bb-aaee-4046-b8ce-097f9c11f9da" returned: 0 in 0.883s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:12 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-832d2c2a-ee58-4984-8ab5-dacc0d07192b tempest-CreateVolumesFromSnapshotTest-902813832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:16:12 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4921f919-bff9-4f10-99e2-e4664651b320]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-832d2c2a-ee58-4984-8ab5-dacc0d07192b tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:12 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:12 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b Jul 07 22:16:12 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9e563d11-b896-4ae0-8b59-07bbfeb205a5 tempest-ProjectReaderTests-1018166429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ccfb5069-9598-4778-9662-3f52f68b95d0" returned: 0 in 0.790s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:12 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9e563d11-b896-4ae0-8b59-07bbfeb205a5 tempest-ProjectReaderTests-1018166429 None] Lock "cinder-quobyte-ccfb5069-9598-4778-9662-3f52f68b95d0" released by "delete_volume" :: held 1.833s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-9e563d11-b896-4ae0-8b59-07bbfeb205a5 tempest-ProjectReaderTests-1018166429 None] Created reservations ['cb90dc3c-d20f-414d-8032-399b84bf9e70', '2e1f570d-e168-4896-8127-1e7de71b1fde', '9d0e6d8b-0165-44e9-b030-49fd397ac787', '15a88cce-4a5c-4828-afa8-bd461f040032'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:13 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8f766a14-c6a4-4933-8068-c7f2dcbcc489 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-76d7be72-ddf1-4036-a1c7-aa42e78cd972" returned: 0 in 0.760s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8f766a14-c6a4-4933-8068-c7f2dcbcc489 tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-76d7be72-ddf1-4036-a1c7-aa42e78cd972" released by "delete_volume" :: held 1.766s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9e563d11-b896-4ae0-8b59-07bbfeb205a5 tempest-ProjectReaderTests-1018166429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9e563d11-b896-4ae0-8b59-07bbfeb205a5 tempest-ProjectReaderTests-1018166429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9e563d11-b896-4ae0-8b59-07bbfeb205a5 tempest-ProjectReaderTests-1018166429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9e563d11-b896-4ae0-8b59-07bbfeb205a5 tempest-ProjectReaderTests-1018166429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9e563d11-b896-4ae0-8b59-07bbfeb205a5 tempest-ProjectReaderTests-1018166429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9e563d11-b896-4ae0-8b59-07bbfeb205a5 tempest-ProjectReaderTests-1018166429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:13 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:16:13 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-8f766a14-c6a4-4933-8068-c7f2dcbcc489 tempest-ProjectReaderTests-302102808 None] Created reservations ['1d6338d4-1079-4a38-bf67-bfb904e1b015', '13b2a12c-779c-4099-a081-106b009be2e8', '5ccd498e-c38c-4406-b1f4-3f3234f9ee6b', '29b43ebf-ee30-4014-bf7c-2d88ecf8e4ba'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Flow 'volume_create_manager' (072468b5-65e2-4125-b20d-dfe8270b15b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ba60c6-c320-4264-8b1b-820099ca06c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ba60c6-c320-4264-8b1b-820099ca06c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2db2be4-700c-4803-9ce5-15953bf5fc03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b0a5315ab340ff966716b8b7f731eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:13Z,use_quota=True,user_id='a553b348019e425da9f8ee20c6d80056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72d3c64-4105-4770-bb11-88ae0243513f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72d3c64-4105-4770-bb11-88ae0243513f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95514d19-312a-4d6f-b3f6-32dd639e598d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95514d19-312a-4d6f-b3f6-32dd639e598d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2db2be4-700c-4803-9ce5-15953bf5fc03', 'volume_name': 'volume-a2db2be4-700c-4803-9ce5-15953bf5fc03', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4919f293-d891-46d0-9824-c589f58071a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4919f293-d891-46d0-9824-c589f58071a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd448f34-30c1-4b87-bdd8-d966e2993e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:13 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Volume a2db2be4-700c-4803-9ce5-15953bf5fc03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2db2be4-700c-4803-9ce5-15953bf5fc03', 'volume_size': 1} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2db2be4-700c-4803-9ce5-15953bf5fc03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b0a5315ab340ff966716b8b7f731eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:13Z,use_quota=True,user_id='a553b348019e425da9f8ee20c6d80056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Creating volume a2db2be4-700c-4803-9ce5-15953bf5fc03 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:16:13 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a2db2be4-700c-4803-9ce5-15953bf5fc03 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:13 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a2db2be4-700c-4803-9ce5-15953bf5fc03 1073741824 Jul 07 22:16:13 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8f766a14-c6a4-4933-8068-c7f2dcbcc489 tempest-ProjectReaderTests-302102808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8f766a14-c6a4-4933-8068-c7f2dcbcc489 tempest-ProjectReaderTests-302102808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8f766a14-c6a4-4933-8068-c7f2dcbcc489 tempest-ProjectReaderTests-302102808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8f766a14-c6a4-4933-8068-c7f2dcbcc489 tempest-ProjectReaderTests-302102808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8f766a14-c6a4-4933-8068-c7f2dcbcc489 tempest-ProjectReaderTests-302102808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8f766a14-c6a4-4933-8068-c7f2dcbcc489 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:13 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:16:13 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:13 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-832d2c2a-ee58-4984-8ab5-dacc0d07192b tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b" returned: 0 in 1.207s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-832d2c2a-ee58-4984-8ab5-dacc0d07192b tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.e03fc7bb-aaee-4046-b8ce-097f9c11f9da {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:13 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.e03fc7bb-aaee-4046-b8ce-097f9c11f9da Jul 07 22:16:13 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Flow 'volume_create_manager' (7a5f8c0c-8468-4ba1-b52f-00bdfce46cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f806f5-3c06-4d71-ae34-d23defba8a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f806f5-3c06-4d71-ae34-d23defba8a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1513799162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db0ebdc-e56c-42d6-b373-29071c888180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='382aa079cf4945d1ae79f19ee7d5388b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:14Z,use_quota=True,user_id='1b646148df8049c2bff812fecc573bfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:14 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f718227-2352-41ef-b559-f3696dcf0fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f718227-2352-41ef-b559-f3696dcf0fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48075031-f75e-401b-b715-fd546c437cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48075031-f75e-401b-b715-fd546c437cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1db0ebdc-e56c-42d6-b373-29071c888180', 'volume_name': 'volume-1db0ebdc-e56c-42d6-b373-29071c888180', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9e96db-5259-470d-8478-0ec6a44a3fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9e96db-5259-470d-8478-0ec6a44a3fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f746f6-70ba-49a1-b0fa-428defba8215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:14 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Volume 1db0ebdc-e56c-42d6-b373-29071c888180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1db0ebdc-e56c-42d6-b373-29071c888180', 'volume_size': 1} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Flow 'volume_create_manager' (547d8f62-bfb1-4987-8181-755b17fb2abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0a477d-ce11-447b-a2e7-58b168eddf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9e563d11-b896-4ae0-8b59-07bbfeb205a5 tempest-ProjectReaderTests-1018166429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.252s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-9e563d11-b896-4ae0-8b59-07bbfeb205a5 tempest-ProjectReaderTests-1018166429 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:16:14 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-9e563d11-b896-4ae0-8b59-07bbfeb205a5 tempest-ProjectReaderTests-1018166429 None] Deleted volume successfully. Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0a477d-ce11-447b-a2e7-58b168eddf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-274101264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3662b1c9-b67b-4475-bede-70e66e62034f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d94796a104ca8b251257af621c466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:14Z,use_quota=True,user_id='bf6b56d5090a4d9c9d2578c8ecc98ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e8b6b0-855d-4375-a0b0-9e2ebbedf528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e8b6b0-855d-4375-a0b0-9e2ebbedf528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0ebd88-2828-4450-961c-fa88ad1cd469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0ebd88-2828-4450-961c-fa88ad1cd469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3662b1c9-b67b-4475-bede-70e66e62034f', 'volume_name': 'volume-3662b1c9-b67b-4475-bede-70e66e62034f', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbda2db0-81c0-45be-a392-cb0eae493073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbda2db0-81c0-45be-a392-cb0eae493073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c7f87dd-5fe3-4930-88b4-56f78471520d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:14 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Volume 3662b1c9-b67b-4475-bede-70e66e62034f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3662b1c9-b67b-4475-bede-70e66e62034f', 'volume_size': 1} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9e563d11-b896-4ae0-8b59-07bbfeb205a5 tempest-ProjectReaderTests-1018166429 None] Lock "cinder-ccfb5069-9598-4778-9662-3f52f68b95d0-delete_volume" released by "delete_volume" :: held 3.481s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:14 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8f766a14-c6a4-4933-8068-c7f2dcbcc489 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 1.082s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-8f766a14-c6a4-4933-8068-c7f2dcbcc489 tempest-ProjectReaderTests-302102808 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:16:14 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-8f766a14-c6a4-4933-8068-c7f2dcbcc489 tempest-ProjectReaderTests-302102808 None] Deleted volume successfully. Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8f766a14-c6a4-4933-8068-c7f2dcbcc489 tempest-ProjectReaderTests-302102808 None] Lock "cinder-76d7be72-ddf1-4036-a1c7-aa42e78cd972-delete_volume" released by "delete_volume" :: held 3.299s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:14 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a2db2be4-700c-4803-9ce5-15953bf5fc03 1073741824" returned: 0 in 1.367s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a2db2be4-700c-4803-9ce5-15953bf5fc03 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:14 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a2db2be4-700c-4803-9ce5-15953bf5fc03 Jul 07 22:16:14 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:14 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-832d2c2a-ee58-4984-8ab5-dacc0d07192b tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.e03fc7bb-aaee-4046-b8ce-097f9c11f9da" returned: 0 in 0.962s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-832d2c2a-ee58-4984-8ab5-dacc0d07192b tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.e03fc7bb-aaee-4046-b8ce-097f9c11f9da {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:14 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.e03fc7bb-aaee-4046-b8ce-097f9c11f9da Jul 07 22:16:14 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:15 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a2db2be4-700c-4803-9ce5-15953bf5fc03" returned: 0 in 0.651s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] <== create_volume: return (2061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:16:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.065s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.084s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1513799162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db0ebdc-e56c-42d6-b373-29071c888180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='382aa079cf4945d1ae79f19ee7d5388b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:14Z,use_quota=True,user_id='1b646148df8049c2bff812fecc573bfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:16:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Creating volume 1db0ebdc-e56c-42d6-b373-29071c888180 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:16:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:15 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:16:15 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:16:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1db0ebdc-e56c-42d6-b373-29071c888180 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd448f34-30c1-4b87-bdd8-d966e2993e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2db2be4-700c-4803-9ce5-15953bf5fc03', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:15 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1db0ebdc-e56c-42d6-b373-29071c888180 1073741824 Jul 07 22:16:15 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (395a1880-224f-4ec3-9496-6b51cc7ff5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:15 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Volume volume-a2db2be4-700c-4803-9ce5-15953bf5fc03 (a2db2be4-700c-4803-9ce5-15953bf5fc03): created successfully Jul 07 22:16:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (395a1880-224f-4ec3-9496-6b51cc7ff5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Flow 'volume_create_manager' (072468b5-65e2-4125-b20d-dfe8270b15b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:15 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-aa2ed3d8-fcb9-4c45-ab06-6231bfc5af0a tempest-CinderUnicodeTest-2117194340 None] Created volume successfully. Jul 07 22:16:15 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-832d2c2a-ee58-4984-8ab5-dacc0d07192b tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b.e03fc7bb-aaee-4046-b8ce-097f9c11f9da" returned: 0 in 0.769s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-832d2c2a-ee58-4984-8ab5-dacc0d07192b tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-quobyte-e03fc7bb-aaee-4046-b8ce-097f9c11f9da" released by "_delete_snapshot" :: held 3.924s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-832d2c2a-ee58-4984-8ab5-dacc0d07192b tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-quobyte-e44818ea-83ad-4e7f-a312-dcd0f8e6576b" released by "delete_snapshot" :: held 3.951s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:15 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-832d2c2a-ee58-4984-8ab5-dacc0d07192b tempest-CreateVolumesFromSnapshotTest-902813832 None] Created reservations ['00cd176d-b74f-472a-98c5-008281d9e63a', 'b83f28e5-f138-46b6-8897-8f6ab4b73f21', '14fbeefd-64e9-439b-b952-64b2e92053c1', '41432632-3f4e-4d98-8d9b-6949675bbea4'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:15 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-832d2c2a-ee58-4984-8ab5-dacc0d07192b tempest-CreateVolumesFromSnapshotTest-902813832 None] Delete snapshot completed successfully. Jul 07 22:16:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-832d2c2a-ee58-4984-8ab5-dacc0d07192b tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-e03fc7bb-aaee-4046-b8ce-097f9c11f9da-delete_snapshot" released by "delete_snapshot" :: held 4.108s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6c59e13c-c6da-4645-b1fe-05458e413e56 tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "cinder-e44818ea-83ad-4e7f-a312-dcd0f8e6576b-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6c59e13c-c6da-4645-b1fe-05458e413e56 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-e44818ea-83ad-4e7f-a312-dcd0f8e6576b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6c59e13c-c6da-4645-b1fe-05458e413e56 tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "cinder-quobyte-e44818ea-83ad-4e7f-a312-dcd0f8e6576b" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6c59e13c-c6da-4645-b1fe-05458e413e56 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-quobyte-e44818ea-83ad-4e7f-a312-dcd0f8e6576b" acquired by "delete_volume" :: waited 0.021s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:16 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3e94a7-cc2f-4e89-9ca0-260737558e0d]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6c59e13c-c6da-4645-b1fe-05458e413e56 tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:16 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1db0ebdc-e56c-42d6-b373-29071c888180 1073741824" returned: 0 in 0.933s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:16 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b Jul 07 22:16:16 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1db0ebdc-e56c-42d6-b373-29071c888180 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:16 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1db0ebdc-e56c-42d6-b373-29071c888180 Jul 07 22:16:16 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:16 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Flow 'volume_create_manager' (f3f18705-2f59-430b-9220-cf55f9dc96a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e03fb81-55ea-4968-bdc0-c0ca3d1ab439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e03fb81-55ea-4968-bdc0-c0ca3d1ab439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-767032387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e562e0-33d9-4ebb-9939-4cf1e3f6f646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b0a5315ab340ff966716b8b7f731eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:17Z,use_quota=True,user_id='a553b348019e425da9f8ee20c6d80056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9fabb7d-3a92-439e-8670-40567f9d37a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9fabb7d-3a92-439e-8670-40567f9d37a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e41b7d-edbb-4552-acf1-12430e7f97e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e41b7d-edbb-4552-acf1-12430e7f97e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26e562e0-33d9-4ebb-9939-4cf1e3f6f646', 'volume_name': 'volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b49e98-1398-438a-9b53-6272dbea9a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b49e98-1398-438a-9b53-6272dbea9a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c4a8e4-8ccc-47c8-9861-2bbb16fa1687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:17 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Volume 26e562e0-33d9-4ebb-9939-4cf1e3f6f646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646', 'volume_size': 1} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:17 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6c59e13c-c6da-4645-b1fe-05458e413e56 tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b" returned: 0 in 0.819s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6c59e13c-c6da-4645-b1fe-05458e413e56 tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:17 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b Jul 07 22:16:17 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:17 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1db0ebdc-e56c-42d6-b373-29071c888180" returned: 0 in 0.811s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.803s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-274101264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3662b1c9-b67b-4475-bede-70e66e62034f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d94796a104ca8b251257af621c466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:14Z,use_quota=True,user_id='bf6b56d5090a4d9c9d2578c8ecc98ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Creating volume 3662b1c9-b67b-4475-bede-70e66e62034f {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:16:17 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f746f6-70ba-49a1-b0fa-428defba8215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1db0ebdc-e56c-42d6-b373-29071c888180', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:17 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f 1073741824 Jul 07 22:16:17 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab433445-119b-4827-91dc-687f105fd100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:17 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Volume volume-1db0ebdc-e56c-42d6-b373-29071c888180 (1db0ebdc-e56c-42d6-b373-29071c888180): created successfully Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab433445-119b-4827-91dc-687f105fd100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Flow 'volume_create_manager' (7a5f8c0c-8468-4ba1-b52f-00bdfce46cb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:17 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-53988de0-1bdc-4631-926f-3eb9f21a9bf7 tempest-ProjectReaderTests-1018166429 None] Created volume successfully. Jul 07 22:16:17 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6c59e13c-c6da-4645-b1fe-05458e413e56 tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e44818ea-83ad-4e7f-a312-dcd0f8e6576b" returned: 0 in 0.694s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6c59e13c-c6da-4645-b1fe-05458e413e56 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-quobyte-e44818ea-83ad-4e7f-a312-dcd0f8e6576b" released by "delete_volume" :: held 1.586s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-6c59e13c-c6da-4645-b1fe-05458e413e56 tempest-CreateVolumesFromSnapshotTest-902813832 None] Created reservations ['6a0f360d-0537-4907-af24-b30815896002', '23e183b5-41b1-45e2-8036-e36b4acbade9', '9ed54e42-3022-4d17-8d42-6a46dfc75d9e', '2149a2cf-314f-4c05-b7ac-a3f4464a2456'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6c59e13c-c6da-4645-b1fe-05458e413e56 tempest-CreateVolumesFromSnapshotTest-902813832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6c59e13c-c6da-4645-b1fe-05458e413e56 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6c59e13c-c6da-4645-b1fe-05458e413e56 tempest-CreateVolumesFromSnapshotTest-902813832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6c59e13c-c6da-4645-b1fe-05458e413e56 tempest-CreateVolumesFromSnapshotTest-902813832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6c59e13c-c6da-4645-b1fe-05458e413e56 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6c59e13c-c6da-4645-b1fe-05458e413e56 tempest-CreateVolumesFromSnapshotTest-902813832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:17 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:16:17 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:18 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f 1073741824" returned: 0 in 0.918s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:18 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f Jul 07 22:16:18 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-913389bd-ea98-4e26-9846-32c253243765 tempest-ProjectReaderTests-1018166429 None] Acquiring lock "cinder-1db0ebdc-e56c-42d6-b373-29071c888180-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-913389bd-ea98-4e26-9846-32c253243765 tempest-ProjectReaderTests-1018166429 None] Lock "cinder-1db0ebdc-e56c-42d6-b373-29071c888180-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-913389bd-ea98-4e26-9846-32c253243765 tempest-ProjectReaderTests-1018166429 None] Acquiring lock "cinder-quobyte-1db0ebdc-e56c-42d6-b373-29071c888180" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-913389bd-ea98-4e26-9846-32c253243765 tempest-ProjectReaderTests-1018166429 None] Lock "cinder-quobyte-1db0ebdc-e56c-42d6-b373-29071c888180" acquired by "delete_volume" :: waited 0.023s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:18 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[da13f29e-9c5d-4ae8-a186-97c619f18aba]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-913389bd-ea98-4e26-9846-32c253243765 tempest-ProjectReaderTests-1018166429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1db0ebdc-e56c-42d6-b373-29071c888180 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:18 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6c59e13c-c6da-4645-b1fe-05458e413e56 tempest-CreateVolumesFromSnapshotTest-902813832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.714s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:18 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-6c59e13c-c6da-4645-b1fe-05458e413e56 tempest-CreateVolumesFromSnapshotTest-902813832 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:16:18 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6c59e13c-c6da-4645-b1fe-05458e413e56 tempest-CreateVolumesFromSnapshotTest-902813832 None] Deleted volume successfully. Jul 07 22:16:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6c59e13c-c6da-4645-b1fe-05458e413e56 tempest-CreateVolumesFromSnapshotTest-902813832 None] Lock "cinder-e44818ea-83ad-4e7f-a312-dcd0f8e6576b-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:18 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1db0ebdc-e56c-42d6-b373-29071c888180 Jul 07 22:16:18 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:19 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f" returned: 0 in 0.913s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:16:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.103s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-767032387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e562e0-33d9-4ebb-9939-4cf1e3f6f646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b0a5315ab340ff966716b8b7f731eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:17Z,use_quota=True,user_id='a553b348019e425da9f8ee20c6d80056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:16:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Creating volume 26e562e0-33d9-4ebb-9939-4cf1e3f6f646 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:16:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:16:19 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:16:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:19 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646 1073741824 Jul 07 22:16:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c7f87dd-5fe3-4930-88b4-56f78471520d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3662b1c9-b67b-4475-bede-70e66e62034f', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:19 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ab3c85-de6e-4c4b-9bd2-a40e36db018c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:19 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Volume volume-3662b1c9-b67b-4475-bede-70e66e62034f (3662b1c9-b67b-4475-bede-70e66e62034f): created successfully Jul 07 22:16:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ab3c85-de6e-4c4b-9bd2-a40e36db018c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Flow 'volume_create_manager' (547d8f62-bfb1-4987-8181-755b17fb2abd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:19 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-8a2fcd8c-9ffc-42f7-8168-f692ff3a1043 tempest-ProjectReaderTests-302102808 None] Created volume successfully. Jul 07 22:16:19 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-913389bd-ea98-4e26-9846-32c253243765 tempest-ProjectReaderTests-1018166429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1db0ebdc-e56c-42d6-b373-29071c888180" returned: 0 in 0.943s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-913389bd-ea98-4e26-9846-32c253243765 tempest-ProjectReaderTests-1018166429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1db0ebdc-e56c-42d6-b373-29071c888180 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:19 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1db0ebdc-e56c-42d6-b373-29071c888180 Jul 07 22:16:19 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9d49b4ad-1f17-40c6-b343-9e12216c7eb8 tempest-ProjectReaderTests-302102808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:20 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-913389bd-ea98-4e26-9846-32c253243765 tempest-ProjectReaderTests-1018166429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-1db0ebdc-e56c-42d6-b373-29071c888180" returned: 0 in 0.847s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:20 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646 1073741824" returned: 0 in 1.189s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-913389bd-ea98-4e26-9846-32c253243765 tempest-ProjectReaderTests-1018166429 None] Lock "cinder-quobyte-1db0ebdc-e56c-42d6-b373-29071c888180" released by "delete_volume" :: held 1.850s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:20 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646 Jul 07 22:16:20 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:20 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-913389bd-ea98-4e26-9846-32c253243765 tempest-ProjectReaderTests-1018166429 None] Created reservations ['d3280208-59f2-4119-a3c3-837c8606fa14', '6eb69b58-446a-49f8-8ace-1cfc91e3e287', 'b4ef9630-5ef2-4b70-a18c-5cc8e033aa72', '43f81e58-7b8c-4f40-91dd-a7e33dbf1b27'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-913389bd-ea98-4e26-9846-32c253243765 tempest-ProjectReaderTests-1018166429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-913389bd-ea98-4e26-9846-32c253243765 tempest-ProjectReaderTests-1018166429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-913389bd-ea98-4e26-9846-32c253243765 tempest-ProjectReaderTests-1018166429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-913389bd-ea98-4e26-9846-32c253243765 tempest-ProjectReaderTests-1018166429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-913389bd-ea98-4e26-9846-32c253243765 tempest-ProjectReaderTests-1018166429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-913389bd-ea98-4e26-9846-32c253243765 tempest-ProjectReaderTests-1018166429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:20 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:16:20 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:21 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646" returned: 0 in 0.830s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:16:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.089s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9d49b4ad-1f17-40c6-b343-9e12216c7eb8 tempest-ProjectReaderTests-302102808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.443s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:21 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c4a8e4-8ccc-47c8-9861-2bbb16fa1687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e7e21a4-64d0-43a0-85fc-e13d9b42f98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-9d49b4ad-1f17-40c6-b343-9e12216c7eb8 tempest-ProjectReaderTests-302102808 None] Creating offline snapshot 8c2c280f-2f23-4471-bc5e-1fd497b01454 of volume 3662b1c9-b67b-4475-bede-70e66e62034f {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:16:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-913389bd-ea98-4e26-9846-32c253243765 tempest-ProjectReaderTests-1018166429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.792s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:21 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-913389bd-ea98-4e26-9846-32c253243765 tempest-ProjectReaderTests-1018166429 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:16:21 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Volume volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646 (26e562e0-33d9-4ebb-9939-4cf1e3f6f646): created successfully Jul 07 22:16:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e7e21a4-64d0-43a0-85fc-e13d9b42f98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Flow 'volume_create_manager' (f3f18705-2f59-430b-9220-cf55f9dc96a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:21 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-913389bd-ea98-4e26-9846-32c253243765 tempest-ProjectReaderTests-1018166429 None] Deleted volume successfully. Jul 07 22:16:21 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[edba9b74-3a37-4f18-b59d-b77d98de2936]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d49b4ad-1f17-40c6-b343-9e12216c7eb8 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:21 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-79ef1b28-93ce-48d7-914b-7360c904cdbd tempest-CinderUnicodeTest-2117194340 None] Created volume successfully. Jul 07 22:16:21 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-913389bd-ea98-4e26-9846-32c253243765 tempest-ProjectReaderTests-1018166429 None] Lock "cinder-1db0ebdc-e56c-42d6-b373-29071c888180-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:21 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f Jul 07 22:16:21 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:22 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d49b4ad-1f17-40c6-b343-9e12216c7eb8 tempest-ProjectReaderTests-302102808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f" returned: 0 in 0.896s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d49b4ad-1f17-40c6-b343-9e12216c7eb8 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.8c2c280f-2f23-4471-bc5e-1fd497b01454 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:22 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.8c2c280f-2f23-4471-bc5e-1fd497b01454 1G Jul 07 22:16:22 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5a9a67b8-1d8c-458c-a2a7-994640216e45 tempest-CinderUnicodeTest-2117194340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:23 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d49b4ad-1f17-40c6-b343-9e12216c7eb8 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.8c2c280f-2f23-4471-bc5e-1fd497b01454 1G" returned: 0 in 1.013s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d49b4ad-1f17-40c6-b343-9e12216c7eb8 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3662b1c9-b67b-4475-bede-70e66e62034f -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.8c2c280f-2f23-4471-bc5e-1fd497b01454 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:23 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3662b1c9-b67b-4475-bede-70e66e62034f -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.8c2c280f-2f23-4471-bc5e-1fd497b01454 Jul 07 22:16:23 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:24 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d49b4ad-1f17-40c6-b343-9e12216c7eb8 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3662b1c9-b67b-4475-bede-70e66e62034f -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.8c2c280f-2f23-4471-bc5e-1fd497b01454" returned: 0 in 0.799s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:24 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-9d49b4ad-1f17-40c6-b343-9e12216c7eb8 tempest-ProjectReaderTests-302102808 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.8c2c280f-2f23-4471-bc5e-1fd497b01454 is being set with open permissions: ugo+rw Jul 07 22:16:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d49b4ad-1f17-40c6-b343-9e12216c7eb8 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.8c2c280f-2f23-4471-bc5e-1fd497b01454 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:24 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.8c2c280f-2f23-4471-bc5e-1fd497b01454 Jul 07 22:16:24 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:24 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d49b4ad-1f17-40c6-b343-9e12216c7eb8 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.8c2c280f-2f23-4471-bc5e-1fd497b01454" returned: 0 in 0.683s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d49b4ad-1f17-40c6-b343-9e12216c7eb8 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:24 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.info Jul 07 22:16:24 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:25 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:16:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Flow 'volume_create_manager' (ec76348f-82eb-4c5e-9e73-a13cea9039a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec92cce-5be0-4718-959f-c060bde0fddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec92cce-5be0-4718-959f-c060bde0fddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-848154058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd995589-9ca8-41de-b328-b6622bfac20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34bb8bdabe5d43ada132cfe1fda4606c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:25Z,use_quota=True,user_id='edda5a3cad444e699fe974cd00dec740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aae916fa-b996-4a0d-92c3-c287be271fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aae916fa-b996-4a0d-92c3-c287be271fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9083e301-8821-415a-be66-e24c725078d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9083e301-8821-415a-be66-e24c725078d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd995589-9ca8-41de-b328-b6622bfac20b', 'volume_name': 'volume-dd995589-9ca8-41de-b328-b6622bfac20b', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1def863e-e3d2-410a-bd51-672891475a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1def863e-e3d2-410a-bd51-672891475a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7906339e-014d-424a-8788-03279a4516e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:25 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Volume dd995589-9ca8-41de-b328-b6622bfac20b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd995589-9ca8-41de-b328-b6622bfac20b', 'volume_size': 1} Jul 07 22:16:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:25 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d49b4ad-1f17-40c6-b343-9e12216c7eb8 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.info" returned: 0 in 0.728s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:25 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-9d49b4ad-1f17-40c6-b343-9e12216c7eb8 tempest-ProjectReaderTests-302102808 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.info is being set with open permissions: ugo+rw Jul 07 22:16:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d49b4ad-1f17-40c6-b343-9e12216c7eb8 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:25 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.info Jul 07 22:16:25 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:26 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9d49b4ad-1f17-40c6-b343-9e12216c7eb8 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.info" returned: 0 in 0.762s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9d49b4ad-1f17-40c6-b343-9e12216c7eb8 tempest-ProjectReaderTests-302102808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.036s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5a9a67b8-1d8c-458c-a2a7-994640216e45 tempest-CinderUnicodeTest-2117194340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.559s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-5a9a67b8-1d8c-458c-a2a7-994640216e45 tempest-CinderUnicodeTest-2117194340 None] Creating offline snapshot 8bbda66e-0585-4691-ad32-edc2cea971e1 of volume 26e562e0-33d9-4ebb-9939-4cf1e3f6f646 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:16:26 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-9d49b4ad-1f17-40c6-b343-9e12216c7eb8 tempest-ProjectReaderTests-302102808 None] Create snapshot completed successfully Jul 07 22:16:26 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca23deb-984b-40e0-8bc8-6b57d46ecda4]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a9a67b8-1d8c-458c-a2a7-994640216e45 tempest-CinderUnicodeTest-2117194340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:26 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646 Jul 07 22:16:26 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:27 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3a086309-fd02-441e-a12b-f08ba6538c68 tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-8c2c280f-2f23-4471-bc5e-1fd497b01454-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a9a67b8-1d8c-458c-a2a7-994640216e45 tempest-CinderUnicodeTest-2117194340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646" returned: 0 in 0.808s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a9a67b8-1d8c-458c-a2a7-994640216e45 tempest-CinderUnicodeTest-2117194340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.8bbda66e-0585-4691-ad32-edc2cea971e1 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3a086309-fd02-441e-a12b-f08ba6538c68 tempest-ProjectReaderTests-302102808 None] Lock "cinder-8c2c280f-2f23-4471-bc5e-1fd497b01454-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3a086309-fd02-441e-a12b-f08ba6538c68 tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-quobyte-3662b1c9-b67b-4475-bede-70e66e62034f" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:27 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.8bbda66e-0585-4691-ad32-edc2cea971e1 1G Jul 07 22:16:27 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3a086309-fd02-441e-a12b-f08ba6538c68 tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-3662b1c9-b67b-4475-bede-70e66e62034f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3a086309-fd02-441e-a12b-f08ba6538c68 tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-quobyte-8c2c280f-2f23-4471-bc5e-1fd497b01454" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3a086309-fd02-441e-a12b-f08ba6538c68 tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-8c2c280f-2f23-4471-bc5e-1fd497b01454" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:27 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-3a086309-fd02-441e-a12b-f08ba6538c68 tempest-ProjectReaderTests-302102808 None] Deleting offline snapshot 8c2c280f-2f23-4471-bc5e-1fd497b01454 of volume 3662b1c9-b67b-4475-bede-70e66e62034f {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:16:27 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-3a086309-fd02-441e-a12b-f08ba6538c68 tempest-ProjectReaderTests-302102808 None] snapshot_file for this snap is: volume-3662b1c9-b67b-4475-bede-70e66e62034f.8c2c280f-2f23-4471-bc5e-1fd497b01454 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:16:27 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc8be25-3d27-4dce-9941-ef38190e9a7b]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3a086309-fd02-441e-a12b-f08ba6538c68 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.8c2c280f-2f23-4471-bc5e-1fd497b01454 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:27 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.8c2c280f-2f23-4471-bc5e-1fd497b01454 Jul 07 22:16:27 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:28 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a9a67b8-1d8c-458c-a2a7-994640216e45 tempest-CinderUnicodeTest-2117194340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.8bbda66e-0585-4691-ad32-edc2cea971e1 1G" returned: 0 in 0.912s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a9a67b8-1d8c-458c-a2a7-994640216e45 tempest-CinderUnicodeTest-2117194340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.8bbda66e-0585-4691-ad32-edc2cea971e1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:28 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.8bbda66e-0585-4691-ad32-edc2cea971e1 Jul 07 22:16:28 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:28 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3a086309-fd02-441e-a12b-f08ba6538c68 tempest-ProjectReaderTests-302102808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.8c2c280f-2f23-4471-bc5e-1fd497b01454" returned: 0 in 0.833s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:28 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-3a086309-fd02-441e-a12b-f08ba6538c68 tempest-ProjectReaderTests-302102808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3662b1c9-b67b-4475-bede-70e66e62034f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:16:28 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fbe77a-4ede-42df-a432-c1ff56e1945b]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3a086309-fd02-441e-a12b-f08ba6538c68 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:28 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:16:28 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f Jul 07 22:16:28 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Flow 'volume_create_manager' (e39523f1-21a6-4cce-8f50-28c33398824f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71eca92f-e59b-47e7-90c2-2162ee84e301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71eca92f-e59b-47e7-90c2-2162ee84e301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2031894504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654968ea-6342-4ba6-8516-e6876730c798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72ec43c2b314ec2b44c0cd84238b6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:28Z,use_quota=True,user_id='cc4275e59c51481badff6b228bedd03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae6a6c9-bb79-4ba1-ba10-dd2a4971485e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae6a6c9-bb79-4ba1-ba10-dd2a4971485e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c505423-c8a5-4d71-82a1-5195247f1990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c505423-c8a5-4d71-82a1-5195247f1990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '654968ea-6342-4ba6-8516-e6876730c798', 'volume_name': 'volume-654968ea-6342-4ba6-8516-e6876730c798', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba53ed77-efd3-4942-b2e4-98fe68c1110e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba53ed77-efd3-4942-b2e4-98fe68c1110e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:28 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2448ed96-5856-43a4-aade-40d5d0789591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:28 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Volume 654968ea-6342-4ba6-8516-e6876730c798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-654968ea-6342-4ba6-8516-e6876730c798', 'volume_size': 1} Jul 07 22:16:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:28 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a9a67b8-1d8c-458c-a2a7-994640216e45 tempest-CinderUnicodeTest-2117194340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.8bbda66e-0585-4691-ad32-edc2cea971e1" returned: 0 in 0.713s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:28 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-5a9a67b8-1d8c-458c-a2a7-994640216e45 tempest-CinderUnicodeTest-2117194340 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.8bbda66e-0585-4691-ad32-edc2cea971e1 is being set with open permissions: ugo+rw Jul 07 22:16:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a9a67b8-1d8c-458c-a2a7-994640216e45 tempest-CinderUnicodeTest-2117194340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.8bbda66e-0585-4691-ad32-edc2cea971e1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:28 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.8bbda66e-0585-4691-ad32-edc2cea971e1 Jul 07 22:16:28 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:29 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3a086309-fd02-441e-a12b-f08ba6538c68 tempest-ProjectReaderTests-302102808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f" returned: 0 in 0.824s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3a086309-fd02-441e-a12b-f08ba6538c68 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.8c2c280f-2f23-4471-bc5e-1fd497b01454 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:29 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.8c2c280f-2f23-4471-bc5e-1fd497b01454 Jul 07 22:16:29 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:29 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a9a67b8-1d8c-458c-a2a7-994640216e45 tempest-CinderUnicodeTest-2117194340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.8bbda66e-0585-4691-ad32-edc2cea971e1" returned: 0 in 0.647s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a9a67b8-1d8c-458c-a2a7-994640216e45 tempest-CinderUnicodeTest-2117194340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:29 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.info Jul 07 22:16:29 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:29 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3a086309-fd02-441e-a12b-f08ba6538c68 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.8c2c280f-2f23-4471-bc5e-1fd497b01454" returned: 0 in 0.754s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3a086309-fd02-441e-a12b-f08ba6538c68 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.8c2c280f-2f23-4471-bc5e-1fd497b01454 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:29 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.8c2c280f-2f23-4471-bc5e-1fd497b01454 Jul 07 22:16:29 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:30 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a9a67b8-1d8c-458c-a2a7-994640216e45 tempest-CinderUnicodeTest-2117194340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.info" returned: 0 in 0.662s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:30 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-5a9a67b8-1d8c-458c-a2a7-994640216e45 tempest-CinderUnicodeTest-2117194340 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.info is being set with open permissions: ugo+rw Jul 07 22:16:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a9a67b8-1d8c-458c-a2a7-994640216e45 tempest-CinderUnicodeTest-2117194340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:30 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.info Jul 07 22:16:30 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:30 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3a086309-fd02-441e-a12b-f08ba6538c68 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f.8c2c280f-2f23-4471-bc5e-1fd497b01454" returned: 0 in 0.641s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:30 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3a086309-fd02-441e-a12b-f08ba6538c68 tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-8c2c280f-2f23-4471-bc5e-1fd497b01454" released by "_delete_snapshot" :: held 3.190s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:30 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3a086309-fd02-441e-a12b-f08ba6538c68 tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-3662b1c9-b67b-4475-bede-70e66e62034f" released by "delete_snapshot" :: held 3.219s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:30 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-3a086309-fd02-441e-a12b-f08ba6538c68 tempest-ProjectReaderTests-302102808 None] Created reservations ['ddfddb90-b955-4228-8fbd-359b98851c95', '2eae84df-fc48-4c0d-8c38-154ed85f1bea', '76aa840b-bb83-41e0-bfbb-81aceb86c3ba', '5f5387cd-9ea5-436c-8e2d-67bdf8af0118'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:30 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-3a086309-fd02-441e-a12b-f08ba6538c68 tempest-ProjectReaderTests-302102808 None] Delete snapshot completed successfully. Jul 07 22:16:30 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3a086309-fd02-441e-a12b-f08ba6538c68 tempest-ProjectReaderTests-302102808 None] Lock "cinder-8c2c280f-2f23-4471-bc5e-1fd497b01454-delete_snapshot" released by "delete_snapshot" :: held 3.374s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:30 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a9a67b8-1d8c-458c-a2a7-994640216e45 tempest-CinderUnicodeTest-2117194340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.info" returned: 0 in 0.632s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5a9a67b8-1d8c-458c-a2a7-994640216e45 tempest-CinderUnicodeTest-2117194340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.486s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.384s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-848154058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd995589-9ca8-41de-b328-b6622bfac20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34bb8bdabe5d43ada132cfe1fda4606c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:25Z,use_quota=True,user_id='edda5a3cad444e699fe974cd00dec740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:16:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Creating volume dd995589-9ca8-41de-b328-b6622bfac20b {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:16:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:16:30 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:16:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd995589-9ca8-41de-b328-b6622bfac20b 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:30 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd995589-9ca8-41de-b328-b6622bfac20b 1073741824 Jul 07 22:16:30 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:30 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-5a9a67b8-1d8c-458c-a2a7-994640216e45 tempest-CinderUnicodeTest-2117194340 None] Create snapshot completed successfully Jul 07 22:16:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ee44a547-bb82-4867-b160-f400fadb4b1f tempest-CinderUnicodeTest-2117194340 None] Acquiring lock "cinder-8bbda66e-0585-4691-ad32-edc2cea971e1-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ee44a547-bb82-4867-b160-f400fadb4b1f tempest-CinderUnicodeTest-2117194340 None] Lock "cinder-8bbda66e-0585-4691-ad32-edc2cea971e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ee44a547-bb82-4867-b160-f400fadb4b1f tempest-CinderUnicodeTest-2117194340 None] Acquiring lock "cinder-quobyte-26e562e0-33d9-4ebb-9939-4cf1e3f6f646" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ee44a547-bb82-4867-b160-f400fadb4b1f tempest-CinderUnicodeTest-2117194340 None] Lock "cinder-quobyte-26e562e0-33d9-4ebb-9939-4cf1e3f6f646" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ee44a547-bb82-4867-b160-f400fadb4b1f tempest-CinderUnicodeTest-2117194340 None] Acquiring lock "cinder-quobyte-8bbda66e-0585-4691-ad32-edc2cea971e1" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ee44a547-bb82-4867-b160-f400fadb4b1f tempest-CinderUnicodeTest-2117194340 None] Lock "cinder-quobyte-8bbda66e-0585-4691-ad32-edc2cea971e1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-ee44a547-bb82-4867-b160-f400fadb4b1f tempest-CinderUnicodeTest-2117194340 None] Deleting offline snapshot 8bbda66e-0585-4691-ad32-edc2cea971e1 of volume 26e562e0-33d9-4ebb-9939-4cf1e3f6f646 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:16:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-ee44a547-bb82-4867-b160-f400fadb4b1f tempest-CinderUnicodeTest-2117194340 None] snapshot_file for this snap is: volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.8bbda66e-0585-4691-ad32-edc2cea971e1 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:16:31 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76f83f8-cf42-4489-89fc-96e05681a4f8]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ee44a547-bb82-4867-b160-f400fadb4b1f tempest-CinderUnicodeTest-2117194340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.8bbda66e-0585-4691-ad32-edc2cea971e1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:31 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.8bbda66e-0585-4691-ad32-edc2cea971e1 Jul 07 22:16:31 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-32b82dda-4bf9-4418-a2ef-0b02d1e9cb11 tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-3662b1c9-b67b-4475-bede-70e66e62034f-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-32b82dda-4bf9-4418-a2ef-0b02d1e9cb11 tempest-ProjectReaderTests-302102808 None] Lock "cinder-3662b1c9-b67b-4475-bede-70e66e62034f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-32b82dda-4bf9-4418-a2ef-0b02d1e9cb11 tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-quobyte-3662b1c9-b67b-4475-bede-70e66e62034f" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-32b82dda-4bf9-4418-a2ef-0b02d1e9cb11 tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-3662b1c9-b67b-4475-bede-70e66e62034f" acquired by "delete_volume" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:31 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc635583-6704-40c0-846f-e6ae2f4cda42]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-32b82dda-4bf9-4418-a2ef-0b02d1e9cb11 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:31 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f Jul 07 22:16:31 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:31 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd995589-9ca8-41de-b328-b6622bfac20b 1073741824" returned: 0 in 0.948s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd995589-9ca8-41de-b328-b6622bfac20b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:31 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd995589-9ca8-41de-b328-b6622bfac20b Jul 07 22:16:31 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:32 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ee44a547-bb82-4867-b160-f400fadb4b1f tempest-CinderUnicodeTest-2117194340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.8bbda66e-0585-4691-ad32-edc2cea971e1" returned: 0 in 0.884s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-ee44a547-bb82-4867-b160-f400fadb4b1f tempest-CinderUnicodeTest-2117194340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a6f310-81a1-46ed-baab-fdd47506ae9e]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ee44a547-bb82-4867-b160-f400fadb4b1f tempest-CinderUnicodeTest-2117194340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:32 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646 Jul 07 22:16:32 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:32 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-32b82dda-4bf9-4418-a2ef-0b02d1e9cb11 tempest-ProjectReaderTests-302102808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f" returned: 0 in 0.830s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-32b82dda-4bf9-4418-a2ef-0b02d1e9cb11 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:32 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f Jul 07 22:16:32 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:32 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd995589-9ca8-41de-b328-b6622bfac20b" returned: 0 in 0.702s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.090s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2031894504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654968ea-6342-4ba6-8516-e6876730c798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72ec43c2b314ec2b44c0cd84238b6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:28Z,use_quota=True,user_id='cc4275e59c51481badff6b228bedd03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Creating volume 654968ea-6342-4ba6-8516-e6876730c798 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:16:32 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7906339e-014d-424a-8788-03279a4516e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd995589-9ca8-41de-b328-b6622bfac20b', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:32 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798 1073741824 Jul 07 22:16:32 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d58dc1-f8f6-4d3f-aad2-abf9238ae2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:32 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Volume volume-dd995589-9ca8-41de-b328-b6622bfac20b (dd995589-9ca8-41de-b328-b6622bfac20b): created successfully Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d58dc1-f8f6-4d3f-aad2-abf9238ae2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Flow 'volume_create_manager' (ec76348f-82eb-4c5e-9e73-a13cea9039a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:32 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-e4192094-02c5-437c-bbb8-aa921117e223 tempest-ProjectReaderTests-1910569980 None] Created volume successfully. Jul 07 22:16:32 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-39dc34a7-7ac9-47b3-bfed-462885510f88 tempest-ProjectReaderTests-1910569980 None] Acquiring lock "cinder-dd995589-9ca8-41de-b328-b6622bfac20b-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ee44a547-bb82-4867-b160-f400fadb4b1f tempest-CinderUnicodeTest-2117194340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646" returned: 0 in 0.851s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ee44a547-bb82-4867-b160-f400fadb4b1f tempest-CinderUnicodeTest-2117194340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.8bbda66e-0585-4691-ad32-edc2cea971e1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-39dc34a7-7ac9-47b3-bfed-462885510f88 tempest-ProjectReaderTests-1910569980 None] Lock "cinder-dd995589-9ca8-41de-b328-b6622bfac20b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:33 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.8bbda66e-0585-4691-ad32-edc2cea971e1 Jul 07 22:16:33 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-39dc34a7-7ac9-47b3-bfed-462885510f88 tempest-ProjectReaderTests-1910569980 None] Acquiring lock "cinder-quobyte-dd995589-9ca8-41de-b328-b6622bfac20b" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-39dc34a7-7ac9-47b3-bfed-462885510f88 tempest-ProjectReaderTests-1910569980 None] Lock "cinder-quobyte-dd995589-9ca8-41de-b328-b6622bfac20b" acquired by "delete_volume" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:33 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[83595201-5d89-4277-908f-9a40945221d5]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-39dc34a7-7ac9-47b3-bfed-462885510f88 tempest-ProjectReaderTests-1910569980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd995589-9ca8-41de-b328-b6622bfac20b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:33 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd995589-9ca8-41de-b328-b6622bfac20b Jul 07 22:16:33 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:33 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-32b82dda-4bf9-4418-a2ef-0b02d1e9cb11 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3662b1c9-b67b-4475-bede-70e66e62034f" returned: 0 in 0.838s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-32b82dda-4bf9-4418-a2ef-0b02d1e9cb11 tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-3662b1c9-b67b-4475-bede-70e66e62034f" released by "delete_volume" :: held 1.736s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:33 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-32b82dda-4bf9-4418-a2ef-0b02d1e9cb11 tempest-ProjectReaderTests-302102808 None] Created reservations ['3f95048c-497b-46aa-80ae-a9ab13a76dec', '3dac4fc8-a2d2-4493-b537-09b0206edeab', '4371dc5e-64b9-44a4-b880-eed68d49c1e4', '8fad6cdd-1169-47d2-857e-29266d52bd2e'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-32b82dda-4bf9-4418-a2ef-0b02d1e9cb11 tempest-ProjectReaderTests-302102808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-32b82dda-4bf9-4418-a2ef-0b02d1e9cb11 tempest-ProjectReaderTests-302102808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:33 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-32b82dda-4bf9-4418-a2ef-0b02d1e9cb11 tempest-ProjectReaderTests-302102808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:33 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-32b82dda-4bf9-4418-a2ef-0b02d1e9cb11 tempest-ProjectReaderTests-302102808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-32b82dda-4bf9-4418-a2ef-0b02d1e9cb11 tempest-ProjectReaderTests-302102808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-32b82dda-4bf9-4418-a2ef-0b02d1e9cb11 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:33 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:16:33 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:33 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798 1073741824" returned: 0 in 1.076s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:33 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798 Jul 07 22:16:33 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:33 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ee44a547-bb82-4867-b160-f400fadb4b1f tempest-CinderUnicodeTest-2117194340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.8bbda66e-0585-4691-ad32-edc2cea971e1" returned: 0 in 1.019s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ee44a547-bb82-4867-b160-f400fadb4b1f tempest-CinderUnicodeTest-2117194340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.8bbda66e-0585-4691-ad32-edc2cea971e1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:34 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.8bbda66e-0585-4691-ad32-edc2cea971e1 Jul 07 22:16:34 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:34 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-39dc34a7-7ac9-47b3-bfed-462885510f88 tempest-ProjectReaderTests-1910569980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd995589-9ca8-41de-b328-b6622bfac20b" returned: 0 in 1.046s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-39dc34a7-7ac9-47b3-bfed-462885510f88 tempest-ProjectReaderTests-1910569980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd995589-9ca8-41de-b328-b6622bfac20b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:34 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd995589-9ca8-41de-b328-b6622bfac20b Jul 07 22:16:34 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:34 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-32b82dda-4bf9-4418-a2ef-0b02d1e9cb11 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.902s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-32b82dda-4bf9-4418-a2ef-0b02d1e9cb11 tempest-ProjectReaderTests-302102808 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:16:34 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-32b82dda-4bf9-4418-a2ef-0b02d1e9cb11 tempest-ProjectReaderTests-302102808 None] Deleted volume successfully. Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-32b82dda-4bf9-4418-a2ef-0b02d1e9cb11 tempest-ProjectReaderTests-302102808 None] Lock "cinder-3662b1c9-b67b-4475-bede-70e66e62034f-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Flow 'volume_create_manager' (789296da-ebf9-4a7f-b4c7-c06f07ac871c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dfdc3cb-9bd3-4387-9792-9220ad8c5365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:34 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798" returned: 0 in 0.933s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] <== create_volume: return (2063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.065s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dfdc3cb-9bd3-4387-9792-9220ad8c5365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2119299900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5066440-d8a2-4041-8621-88df61160834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d94796a104ca8b251257af621c466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:34Z,use_quota=True,user_id='bf6b56d5090a4d9c9d2578c8ecc98ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2dd0bb0-2ff2-4a2d-ae13-de72a5100fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2dd0bb0-2ff2-4a2d-ae13-de72a5100fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce52169-04a1-478a-a255-915f0861207e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce52169-04a1-478a-a255-915f0861207e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5066440-d8a2-4041-8621-88df61160834', 'volume_name': 'volume-b5066440-d8a2-4041-8621-88df61160834', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f4857c-329d-4ed6-a76d-c323289eacdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f4857c-329d-4ed6-a76d-c323289eacdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (525c24b9-a848-45c3-ae6d-7dfca4915be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:34 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Volume b5066440-d8a2-4041-8621-88df61160834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5066440-d8a2-4041-8621-88df61160834', 'volume_size': 1} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2119299900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5066440-d8a2-4041-8621-88df61160834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d94796a104ca8b251257af621c466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:34Z,use_quota=True,user_id='bf6b56d5090a4d9c9d2578c8ecc98ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Creating volume b5066440-d8a2-4041-8621-88df61160834 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:16:34 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2448ed96-5856-43a4-aade-40d5d0789591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-654968ea-6342-4ba6-8516-e6876730c798', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:34 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834 1073741824 Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8d7f2f0-b907-4ac6-99b8-8c6c32a12919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:34 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:34 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Volume volume-654968ea-6342-4ba6-8516-e6876730c798 (654968ea-6342-4ba6-8516-e6876730c798): created successfully Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8d7f2f0-b907-4ac6-99b8-8c6c32a12919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Flow 'volume_create_manager' (e39523f1-21a6-4cce-8f50-28c33398824f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:34 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-f994c175-3eaf-45ba-9069-94ea0b0583cc tempest-ProjectMemberTests-811768835 None] Created volume successfully. Jul 07 22:16:34 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ee44a547-bb82-4867-b160-f400fadb4b1f tempest-CinderUnicodeTest-2117194340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646.8bbda66e-0585-4691-ad32-edc2cea971e1" returned: 0 in 0.853s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ee44a547-bb82-4867-b160-f400fadb4b1f tempest-CinderUnicodeTest-2117194340 None] Lock "cinder-quobyte-8bbda66e-0585-4691-ad32-edc2cea971e1" released by "_delete_snapshot" :: held 3.716s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ee44a547-bb82-4867-b160-f400fadb4b1f tempest-CinderUnicodeTest-2117194340 None] Lock "cinder-quobyte-26e562e0-33d9-4ebb-9939-4cf1e3f6f646" released by "delete_snapshot" :: held 3.741s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:34 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-ee44a547-bb82-4867-b160-f400fadb4b1f tempest-CinderUnicodeTest-2117194340 None] Created reservations ['5a0c3f4e-6f7b-4d80-9a77-16e850093b64', '7d9b4390-a8b5-4300-8fef-d0f44022587e', '0b93e796-2224-403a-8260-7fb256804f7c', '786e8ad2-f4de-465a-9c5a-d58d08b1e807'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:35 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-39dc34a7-7ac9-47b3-bfed-462885510f88 tempest-ProjectReaderTests-1910569980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-dd995589-9ca8-41de-b328-b6622bfac20b" returned: 0 in 0.842s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-39dc34a7-7ac9-47b3-bfed-462885510f88 tempest-ProjectReaderTests-1910569980 None] Lock "cinder-quobyte-dd995589-9ca8-41de-b328-b6622bfac20b" released by "delete_volume" :: held 1.951s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:35 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ee44a547-bb82-4867-b160-f400fadb4b1f tempest-CinderUnicodeTest-2117194340 None] Delete snapshot completed successfully. Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ee44a547-bb82-4867-b160-f400fadb4b1f tempest-CinderUnicodeTest-2117194340 None] Lock "cinder-8bbda66e-0585-4691-ad32-edc2cea971e1-delete_snapshot" released by "delete_snapshot" :: held 3.916s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-39dc34a7-7ac9-47b3-bfed-462885510f88 tempest-ProjectReaderTests-1910569980 None] Created reservations ['3885d377-7cc4-4b4c-9f38-b0454c045b24', '1f17f1a9-641f-4c98-ad0a-33457aed0d28', 'e3ac4db8-008d-430a-96e2-654e4bdc0167', 'f419a86b-f50a-4132-85b0-203816d20424'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-39dc34a7-7ac9-47b3-bfed-462885510f88 tempest-ProjectReaderTests-1910569980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-39dc34a7-7ac9-47b3-bfed-462885510f88 tempest-ProjectReaderTests-1910569980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-39dc34a7-7ac9-47b3-bfed-462885510f88 tempest-ProjectReaderTests-1910569980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-39dc34a7-7ac9-47b3-bfed-462885510f88 tempest-ProjectReaderTests-1910569980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-39dc34a7-7ac9-47b3-bfed-462885510f88 tempest-ProjectReaderTests-1910569980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-39dc34a7-7ac9-47b3-bfed-462885510f88 tempest-ProjectReaderTests-1910569980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:35 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:16:35 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-efd14f81-ac1f-4589-b749-34a58fee5efa tempest-CinderUnicodeTest-2117194340 None] Acquiring lock "cinder-26e562e0-33d9-4ebb-9939-4cf1e3f6f646-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-efd14f81-ac1f-4589-b749-34a58fee5efa tempest-CinderUnicodeTest-2117194340 None] Lock "cinder-26e562e0-33d9-4ebb-9939-4cf1e3f6f646-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-efd14f81-ac1f-4589-b749-34a58fee5efa tempest-CinderUnicodeTest-2117194340 None] Acquiring lock "cinder-quobyte-26e562e0-33d9-4ebb-9939-4cf1e3f6f646" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-efd14f81-ac1f-4589-b749-34a58fee5efa tempest-CinderUnicodeTest-2117194340 None] Lock "cinder-quobyte-26e562e0-33d9-4ebb-9939-4cf1e3f6f646" acquired by "delete_volume" :: waited 0.023s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a02f2a-dcf1-4596-89bb-7e6d19c94d93]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-efd14f81-ac1f-4589-b749-34a58fee5efa tempest-CinderUnicodeTest-2117194340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:35 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:16:35 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:35 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834 1073741824" returned: 0 in 1.146s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:35 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646 Jul 07 22:16:35 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:35 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-39dc34a7-7ac9-47b3-bfed-462885510f88 tempest-ProjectReaderTests-1910569980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.771s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:35 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834 Jul 07 22:16:35 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-39dc34a7-7ac9-47b3-bfed-462885510f88 tempest-ProjectReaderTests-1910569980 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:16:35 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-39dc34a7-7ac9-47b3-bfed-462885510f88 tempest-ProjectReaderTests-1910569980 None] Deleted volume successfully. Jul 07 22:16:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-39dc34a7-7ac9-47b3-bfed-462885510f88 tempest-ProjectReaderTests-1910569980 None] Lock "cinder-dd995589-9ca8-41de-b328-b6622bfac20b-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Flow 'volume_create_manager' (230e2bbf-47ed-49f1-a732-b7681b4a0b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8666c0b7-7fe7-44fa-87e8-976701649166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8666c0b7-7fe7-44fa-87e8-976701649166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-255909599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b4a858-2582-46d3-9f21-f545dd412750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34bb8bdabe5d43ada132cfe1fda4606c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:36Z,use_quota=True,user_id='edda5a3cad444e699fe974cd00dec740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47335a86-a567-4b9c-abfd-99e21187e4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47335a86-a567-4b9c-abfd-99e21187e4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a12a76-f81e-41d8-b3ec-8beca1aca760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a12a76-f81e-41d8-b3ec-8beca1aca760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06b4a858-2582-46d3-9f21-f545dd412750', 'volume_name': 'volume-06b4a858-2582-46d3-9f21-f545dd412750', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d067366-bac9-43bc-8c1c-371fc94635da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d067366-bac9-43bc-8c1c-371fc94635da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2be8dc-388e-40b2-ac46-f50923eeb6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:36 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Volume 06b4a858-2582-46d3-9f21-f545dd412750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06b4a858-2582-46d3-9f21-f545dd412750', 'volume_size': 1} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a835b429-954a-423e-92e1-82369c0a1779 tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:36 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.944s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 28 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 22:16:36 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-efd14f81-ac1f-4589-b749-34a58fee5efa tempest-CinderUnicodeTest-2117194340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646" returned: 0 in 1.019s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-efd14f81-ac1f-4589-b749-34a58fee5efa tempest-CinderUnicodeTest-2117194340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:36 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646 Jul 07 22:16:36 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:36 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834" returned: 0 in 0.957s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] <== create_volume: return (2171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.175s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.630s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-255909599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b4a858-2582-46d3-9f21-f545dd412750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34bb8bdabe5d43ada132cfe1fda4606c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:36Z,use_quota=True,user_id='edda5a3cad444e699fe974cd00dec740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Creating volume 06b4a858-2582-46d3-9f21-f545dd412750 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:16:36 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-06b4a858-2582-46d3-9f21-f545dd412750 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:36 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-06b4a858-2582-46d3-9f21-f545dd412750 1073741824 Jul 07 22:16:36 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (525c24b9-a848-45c3-ae6d-7dfca4915be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5066440-d8a2-4041-8621-88df61160834', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21cceef0-3fa5-4a8a-bcda-d86aff4d92b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:36 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Volume volume-b5066440-d8a2-4041-8621-88df61160834 (b5066440-d8a2-4041-8621-88df61160834): created successfully Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21cceef0-3fa5-4a8a-bcda-d86aff4d92b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Flow 'volume_create_manager' (789296da-ebf9-4a7f-b4c7-c06f07ac871c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:36 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-a8c7e3f1-0452-44ca-b6cc-3b123e289b61 tempest-ProjectReaderTests-302102808 None] Created volume successfully. Jul 07 22:16:37 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-efd14f81-ac1f-4589-b749-34a58fee5efa tempest-CinderUnicodeTest-2117194340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-26e562e0-33d9-4ebb-9939-4cf1e3f6f646" returned: 0 in 0.699s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-efd14f81-ac1f-4589-b749-34a58fee5efa tempest-CinderUnicodeTest-2117194340 None] Lock "cinder-quobyte-26e562e0-33d9-4ebb-9939-4cf1e3f6f646" released by "delete_volume" :: held 1.834s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:37 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-efd14f81-ac1f-4589-b749-34a58fee5efa tempest-CinderUnicodeTest-2117194340 None] Created reservations ['dd8e31f4-3e7e-4c96-bb62-7a7e54f96b89', 'b79f7650-37b3-4e5c-b143-c58c3a10609a', '1cdfc4bf-8357-49a8-ac59-6785d77dbf8e', '8b55465d-aecc-4c5d-9eff-1e159e4d429a'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-efd14f81-ac1f-4589-b749-34a58fee5efa tempest-CinderUnicodeTest-2117194340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-efd14f81-ac1f-4589-b749-34a58fee5efa tempest-CinderUnicodeTest-2117194340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-efd14f81-ac1f-4589-b749-34a58fee5efa tempest-CinderUnicodeTest-2117194340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-efd14f81-ac1f-4589-b749-34a58fee5efa tempest-CinderUnicodeTest-2117194340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-efd14f81-ac1f-4589-b749-34a58fee5efa tempest-CinderUnicodeTest-2117194340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-efd14f81-ac1f-4589-b749-34a58fee5efa tempest-CinderUnicodeTest-2117194340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:37 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:16:37 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:37 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-06b4a858-2582-46d3-9f21-f545dd412750 1073741824" returned: 0 in 0.874s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-06b4a858-2582-46d3-9f21-f545dd412750 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:37 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-06b4a858-2582-46d3-9f21-f545dd412750 Jul 07 22:16:37 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d1435e43-8627-4b40-a110-e93e5bf607cd tempest-CinderUnicodeTest-2117194340 None] Acquiring lock "cinder-a2db2be4-700c-4803-9ce5-15953bf5fc03-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d1435e43-8627-4b40-a110-e93e5bf607cd tempest-CinderUnicodeTest-2117194340 None] Lock "cinder-a2db2be4-700c-4803-9ce5-15953bf5fc03-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d1435e43-8627-4b40-a110-e93e5bf607cd tempest-CinderUnicodeTest-2117194340 None] Acquiring lock "cinder-quobyte-a2db2be4-700c-4803-9ce5-15953bf5fc03" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d1435e43-8627-4b40-a110-e93e5bf607cd tempest-CinderUnicodeTest-2117194340 None] Lock "cinder-quobyte-a2db2be4-700c-4803-9ce5-15953bf5fc03" acquired by "delete_volume" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:38 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[185cf4b2-79a5-4bc0-ad67-85f50ed0193c]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d1435e43-8627-4b40-a110-e93e5bf607cd tempest-CinderUnicodeTest-2117194340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a2db2be4-700c-4803-9ce5-15953bf5fc03 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0b04ebd4-91f4-4f19-984f-9ea7952bc490 tempest-ProjectReaderTests-302102808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:38 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a2db2be4-700c-4803-9ce5-15953bf5fc03 Jul 07 22:16:38 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:38 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-efd14f81-ac1f-4589-b749-34a58fee5efa tempest-CinderUnicodeTest-2117194340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.762s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:38 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-efd14f81-ac1f-4589-b749-34a58fee5efa tempest-CinderUnicodeTest-2117194340 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:16:38 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-efd14f81-ac1f-4589-b749-34a58fee5efa tempest-CinderUnicodeTest-2117194340 None] Deleted volume successfully. Jul 07 22:16:38 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-efd14f81-ac1f-4589-b749-34a58fee5efa tempest-CinderUnicodeTest-2117194340 None] Lock "cinder-26e562e0-33d9-4ebb-9939-4cf1e3f6f646-delete_volume" released by "delete_volume" :: held 2.833s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:38 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-06b4a858-2582-46d3-9f21-f545dd412750" returned: 0 in 0.781s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:38 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:16:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a835b429-954a-423e-92e1-82369c0a1779 tempest-ProjectMemberTests-811768835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.050s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:38 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-a835b429-954a-423e-92e1-82369c0a1779 tempest-ProjectMemberTests-811768835 None] Creating offline snapshot 2516b80c-c0f0-4e39-86af-743745c93303 of volume 654968ea-6342-4ba6-8516-e6876730c798 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:16:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2be8dc-388e-40b2-ac46-f50923eeb6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b4a858-2582-46d3-9f21-f545dd412750', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a23a4d0-4040-4ad2-9c3d-c52b473ab59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:38 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fd7a10-6888-4fd4-843c-638463628538]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a835b429-954a-423e-92e1-82369c0a1779 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:38 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Volume volume-06b4a858-2582-46d3-9f21-f545dd412750 (06b4a858-2582-46d3-9f21-f545dd412750): created successfully Jul 07 22:16:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a23a4d0-4040-4ad2-9c3d-c52b473ab59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Flow 'volume_create_manager' (230e2bbf-47ed-49f1-a732-b7681b4a0b12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:38 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-3ae48bdc-6909-48b9-a4f1-a59c18955a02 tempest-ProjectReaderTests-1910569980 None] Created volume successfully. Jul 07 22:16:38 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798 Jul 07 22:16:38 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:38 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d1435e43-8627-4b40-a110-e93e5bf607cd tempest-CinderUnicodeTest-2117194340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a2db2be4-700c-4803-9ce5-15953bf5fc03" returned: 0 in 0.820s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d1435e43-8627-4b40-a110-e93e5bf607cd tempest-CinderUnicodeTest-2117194340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a2db2be4-700c-4803-9ce5-15953bf5fc03 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:38 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a2db2be4-700c-4803-9ce5-15953bf5fc03 Jul 07 22:16:38 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c44fc101-e14e-4463-a296-8f003a53ea3d tempest-ProjectReaderTests-1910569980 None] Acquiring lock "cinder-06b4a858-2582-46d3-9f21-f545dd412750-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c44fc101-e14e-4463-a296-8f003a53ea3d tempest-ProjectReaderTests-1910569980 None] Lock "cinder-06b4a858-2582-46d3-9f21-f545dd412750-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c44fc101-e14e-4463-a296-8f003a53ea3d tempest-ProjectReaderTests-1910569980 None] Acquiring lock "cinder-quobyte-06b4a858-2582-46d3-9f21-f545dd412750" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c44fc101-e14e-4463-a296-8f003a53ea3d tempest-ProjectReaderTests-1910569980 None] Lock "cinder-quobyte-06b4a858-2582-46d3-9f21-f545dd412750" acquired by "delete_volume" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:39 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c944df-1073-4a2b-8f96-ae4a9c8223fc]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c44fc101-e14e-4463-a296-8f003a53ea3d tempest-ProjectReaderTests-1910569980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-06b4a858-2582-46d3-9f21-f545dd412750 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:39 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-06b4a858-2582-46d3-9f21-f545dd412750 Jul 07 22:16:39 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:39 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a835b429-954a-423e-92e1-82369c0a1779 tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798" returned: 0 in 0.800s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a835b429-954a-423e-92e1-82369c0a1779 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.2516b80c-c0f0-4e39-86af-743745c93303 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:39 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.2516b80c-c0f0-4e39-86af-743745c93303 1G Jul 07 22:16:39 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:39 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d1435e43-8627-4b40-a110-e93e5bf607cd tempest-CinderUnicodeTest-2117194340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-a2db2be4-700c-4803-9ce5-15953bf5fc03" returned: 0 in 0.712s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:39 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d1435e43-8627-4b40-a110-e93e5bf607cd tempest-CinderUnicodeTest-2117194340 None] Lock "cinder-quobyte-a2db2be4-700c-4803-9ce5-15953bf5fc03" released by "delete_volume" :: held 1.588s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:39 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-d1435e43-8627-4b40-a110-e93e5bf607cd tempest-CinderUnicodeTest-2117194340 None] Created reservations ['84178173-e903-47a8-8166-bcef21ef7050', '69a5185a-1493-4c2e-bb69-3ea2b75ce8bf', '1e9f5f48-e42d-4172-b69f-66c18416892a', '2ffe01fc-0085-4292-95ae-d159a8afdff7'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d1435e43-8627-4b40-a110-e93e5bf607cd tempest-CinderUnicodeTest-2117194340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d1435e43-8627-4b40-a110-e93e5bf607cd tempest-CinderUnicodeTest-2117194340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:39 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d1435e43-8627-4b40-a110-e93e5bf607cd tempest-CinderUnicodeTest-2117194340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:39 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d1435e43-8627-4b40-a110-e93e5bf607cd tempest-CinderUnicodeTest-2117194340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d1435e43-8627-4b40-a110-e93e5bf607cd tempest-CinderUnicodeTest-2117194340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d1435e43-8627-4b40-a110-e93e5bf607cd tempest-CinderUnicodeTest-2117194340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:39 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:16:39 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:40 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c44fc101-e14e-4463-a296-8f003a53ea3d tempest-ProjectReaderTests-1910569980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-06b4a858-2582-46d3-9f21-f545dd412750" returned: 0 in 0.821s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c44fc101-e14e-4463-a296-8f003a53ea3d tempest-ProjectReaderTests-1910569980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-06b4a858-2582-46d3-9f21-f545dd412750 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:40 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-06b4a858-2582-46d3-9f21-f545dd412750 Jul 07 22:16:40 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:40 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a835b429-954a-423e-92e1-82369c0a1779 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.2516b80c-c0f0-4e39-86af-743745c93303 1G" returned: 0 in 0.920s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a835b429-954a-423e-92e1-82369c0a1779 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-654968ea-6342-4ba6-8516-e6876730c798 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.2516b80c-c0f0-4e39-86af-743745c93303 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:40 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-654968ea-6342-4ba6-8516-e6876730c798 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.2516b80c-c0f0-4e39-86af-743745c93303 Jul 07 22:16:40 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:40 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d1435e43-8627-4b40-a110-e93e5bf607cd tempest-CinderUnicodeTest-2117194340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.726s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:40 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-d1435e43-8627-4b40-a110-e93e5bf607cd tempest-CinderUnicodeTest-2117194340 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:16:40 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d1435e43-8627-4b40-a110-e93e5bf607cd tempest-CinderUnicodeTest-2117194340 None] Deleted volume successfully. Jul 07 22:16:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d1435e43-8627-4b40-a110-e93e5bf607cd tempest-CinderUnicodeTest-2117194340 None] Lock "cinder-a2db2be4-700c-4803-9ce5-15953bf5fc03-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:40 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c44fc101-e14e-4463-a296-8f003a53ea3d tempest-ProjectReaderTests-1910569980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-06b4a858-2582-46d3-9f21-f545dd412750" returned: 0 in 0.740s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c44fc101-e14e-4463-a296-8f003a53ea3d tempest-ProjectReaderTests-1910569980 None] Lock "cinder-quobyte-06b4a858-2582-46d3-9f21-f545dd412750" released by "delete_volume" :: held 1.610s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:40 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-c44fc101-e14e-4463-a296-8f003a53ea3d tempest-ProjectReaderTests-1910569980 None] Created reservations ['13c5d9a2-f06e-422a-959c-881b50ff957e', '43a1e6eb-8440-4d00-a9f8-d066b370d662', 'e1e1c804-0135-4819-a727-d1c8dc61c2bf', '778ab90c-32b9-49b9-9afe-a02fedb93908'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c44fc101-e14e-4463-a296-8f003a53ea3d tempest-ProjectReaderTests-1910569980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c44fc101-e14e-4463-a296-8f003a53ea3d tempest-ProjectReaderTests-1910569980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:40 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c44fc101-e14e-4463-a296-8f003a53ea3d tempest-ProjectReaderTests-1910569980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:40 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c44fc101-e14e-4463-a296-8f003a53ea3d tempest-ProjectReaderTests-1910569980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c44fc101-e14e-4463-a296-8f003a53ea3d tempest-ProjectReaderTests-1910569980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c44fc101-e14e-4463-a296-8f003a53ea3d tempest-ProjectReaderTests-1910569980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:40 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:16:40 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:41 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a835b429-954a-423e-92e1-82369c0a1779 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-654968ea-6342-4ba6-8516-e6876730c798 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.2516b80c-c0f0-4e39-86af-743745c93303" returned: 0 in 0.825s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:41 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-a835b429-954a-423e-92e1-82369c0a1779 tempest-ProjectMemberTests-811768835 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.2516b80c-c0f0-4e39-86af-743745c93303 is being set with open permissions: ugo+rw Jul 07 22:16:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a835b429-954a-423e-92e1-82369c0a1779 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.2516b80c-c0f0-4e39-86af-743745c93303 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:41 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.2516b80c-c0f0-4e39-86af-743745c93303 Jul 07 22:16:41 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:41 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c44fc101-e14e-4463-a296-8f003a53ea3d tempest-ProjectReaderTests-1910569980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.821s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:41 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c44fc101-e14e-4463-a296-8f003a53ea3d tempest-ProjectReaderTests-1910569980 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:16:41 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-c44fc101-e14e-4463-a296-8f003a53ea3d tempest-ProjectReaderTests-1910569980 None] Deleted volume successfully. Jul 07 22:16:41 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c44fc101-e14e-4463-a296-8f003a53ea3d tempest-ProjectReaderTests-1910569980 None] Lock "cinder-06b4a858-2582-46d3-9f21-f545dd412750-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:41 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a835b429-954a-423e-92e1-82369c0a1779 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.2516b80c-c0f0-4e39-86af-743745c93303" returned: 0 in 0.724s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a835b429-954a-423e-92e1-82369c0a1779 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:41 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.info Jul 07 22:16:41 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:42 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:16:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Flow 'volume_create_manager' (52c3e4f4-7892-415b-a7cb-c2ae169fd02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38d6a60-66e9-48dd-95bc-a85feb77f5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38d6a60-66e9-48dd-95bc-a85feb77f5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1849175656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d862ecf-236b-4cae-aef3-294fd6995e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34bb8bdabe5d43ada132cfe1fda4606c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:42Z,use_quota=True,user_id='edda5a3cad444e699fe974cd00dec740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1a0e5c-1325-47be-bdc3-73fb4712b99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1a0e5c-1325-47be-bdc3-73fb4712b99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d919f34f-7d0c-4ec3-b2b4-20931dca6139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d919f34f-7d0c-4ec3-b2b4-20931dca6139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d862ecf-236b-4cae-aef3-294fd6995e72', 'volume_name': 'volume-6d862ecf-236b-4cae-aef3-294fd6995e72', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb76ca60-64ff-4487-8aa5-25722a5e4ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb76ca60-64ff-4487-8aa5-25722a5e4ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:42 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113032c1-bd5d-47a3-83ff-01f413075418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:42 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Volume 6d862ecf-236b-4cae-aef3-294fd6995e72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d862ecf-236b-4cae-aef3-294fd6995e72', 'volume_size': 1} Jul 07 22:16:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:42 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a835b429-954a-423e-92e1-82369c0a1779 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.info" returned: 0 in 0.674s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:42 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-a835b429-954a-423e-92e1-82369c0a1779 tempest-ProjectMemberTests-811768835 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.info is being set with open permissions: ugo+rw Jul 07 22:16:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a835b429-954a-423e-92e1-82369c0a1779 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:42 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.info Jul 07 22:16:42 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:43 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a835b429-954a-423e-92e1-82369c0a1779 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.info" returned: 0 in 0.652s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a835b429-954a-423e-92e1-82369c0a1779 tempest-ProjectMemberTests-811768835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.716s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0b04ebd4-91f4-4f19-984f-9ea7952bc490 tempest-ProjectReaderTests-302102808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.230s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-0b04ebd4-91f4-4f19-984f-9ea7952bc490 tempest-ProjectReaderTests-302102808 None] Creating offline snapshot b987ae3e-73c7-4c3e-a07c-977433d13b8d of volume b5066440-d8a2-4041-8621-88df61160834 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:16:43 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-a835b429-954a-423e-92e1-82369c0a1779 tempest-ProjectMemberTests-811768835 None] Create snapshot completed successfully Jul 07 22:16:43 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93acb78-6adc-4ced-9e47-36ed16172dfd]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0b04ebd4-91f4-4f19-984f-9ea7952bc490 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:43 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834 Jul 07 22:16:43 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4a511e21-4ce8-4587-a3b4-6436790019ea tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-2516b80c-c0f0-4e39-86af-743745c93303-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4a511e21-4ce8-4587-a3b4-6436790019ea tempest-ProjectMemberTests-811768835 None] Lock "cinder-2516b80c-c0f0-4e39-86af-743745c93303-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4a511e21-4ce8-4587-a3b4-6436790019ea tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-654968ea-6342-4ba6-8516-e6876730c798" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4a511e21-4ce8-4587-a3b4-6436790019ea tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-654968ea-6342-4ba6-8516-e6876730c798" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4a511e21-4ce8-4587-a3b4-6436790019ea tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-2516b80c-c0f0-4e39-86af-743745c93303" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4a511e21-4ce8-4587-a3b4-6436790019ea tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-2516b80c-c0f0-4e39-86af-743745c93303" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-4a511e21-4ce8-4587-a3b4-6436790019ea tempest-ProjectMemberTests-811768835 None] Deleting offline snapshot 2516b80c-c0f0-4e39-86af-743745c93303 of volume 654968ea-6342-4ba6-8516-e6876730c798 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:16:43 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-4a511e21-4ce8-4587-a3b4-6436790019ea tempest-ProjectMemberTests-811768835 None] snapshot_file for this snap is: volume-654968ea-6342-4ba6-8516-e6876730c798.2516b80c-c0f0-4e39-86af-743745c93303 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:16:44 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[466b633f-d756-485b-b7a3-7b256747100e]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4a511e21-4ce8-4587-a3b4-6436790019ea tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.2516b80c-c0f0-4e39-86af-743745c93303 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:44 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.2516b80c-c0f0-4e39-86af-743745c93303 Jul 07 22:16:44 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:44 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0b04ebd4-91f4-4f19-984f-9ea7952bc490 tempest-ProjectReaderTests-302102808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834" returned: 0 in 0.860s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0b04ebd4-91f4-4f19-984f-9ea7952bc490 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.b987ae3e-73c7-4c3e-a07c-977433d13b8d 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:44 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.b987ae3e-73c7-4c3e-a07c-977433d13b8d 1G Jul 07 22:16:44 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:44 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4a511e21-4ce8-4587-a3b4-6436790019ea tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.2516b80c-c0f0-4e39-86af-743745c93303" returned: 0 in 0.858s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:44 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-4a511e21-4ce8-4587-a3b4-6436790019ea tempest-ProjectMemberTests-811768835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-654968ea-6342-4ba6-8516-e6876730c798(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:16:44 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25e1bf7-e107-46e1-ba3f-2f3939a09620]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4a511e21-4ce8-4587-a3b4-6436790019ea tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:45 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798 Jul 07 22:16:45 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:45 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0b04ebd4-91f4-4f19-984f-9ea7952bc490 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.b987ae3e-73c7-4c3e-a07c-977433d13b8d 1G" returned: 0 in 0.926s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0b04ebd4-91f4-4f19-984f-9ea7952bc490 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5066440-d8a2-4041-8621-88df61160834 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.b987ae3e-73c7-4c3e-a07c-977433d13b8d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:45 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5066440-d8a2-4041-8621-88df61160834 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.b987ae3e-73c7-4c3e-a07c-977433d13b8d Jul 07 22:16:45 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:45 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4a511e21-4ce8-4587-a3b4-6436790019ea tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798" returned: 0 in 0.870s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4a511e21-4ce8-4587-a3b4-6436790019ea tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.2516b80c-c0f0-4e39-86af-743745c93303 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:45 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.2516b80c-c0f0-4e39-86af-743745c93303 Jul 07 22:16:45 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:45 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0b04ebd4-91f4-4f19-984f-9ea7952bc490 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5066440-d8a2-4041-8621-88df61160834 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.b987ae3e-73c7-4c3e-a07c-977433d13b8d" returned: 0 in 0.806s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:45 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-0b04ebd4-91f4-4f19-984f-9ea7952bc490 tempest-ProjectReaderTests-302102808 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.b987ae3e-73c7-4c3e-a07c-977433d13b8d is being set with open permissions: ugo+rw Jul 07 22:16:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0b04ebd4-91f4-4f19-984f-9ea7952bc490 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.b987ae3e-73c7-4c3e-a07c-977433d13b8d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:45 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.b987ae3e-73c7-4c3e-a07c-977433d13b8d Jul 07 22:16:45 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:46 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4a511e21-4ce8-4587-a3b4-6436790019ea tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.2516b80c-c0f0-4e39-86af-743745c93303" returned: 0 in 0.856s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4a511e21-4ce8-4587-a3b4-6436790019ea tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.2516b80c-c0f0-4e39-86af-743745c93303 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:46 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.2516b80c-c0f0-4e39-86af-743745c93303 Jul 07 22:16:46 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:46 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0b04ebd4-91f4-4f19-984f-9ea7952bc490 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.b987ae3e-73c7-4c3e-a07c-977433d13b8d" returned: 0 in 0.812s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0b04ebd4-91f4-4f19-984f-9ea7952bc490 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:46 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.info Jul 07 22:16:46 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:47 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4a511e21-4ce8-4587-a3b4-6436790019ea tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798.2516b80c-c0f0-4e39-86af-743745c93303" returned: 0 in 0.700s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:47 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4a511e21-4ce8-4587-a3b4-6436790019ea tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-2516b80c-c0f0-4e39-86af-743745c93303" released by "_delete_snapshot" :: held 3.431s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:47 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4a511e21-4ce8-4587-a3b4-6436790019ea tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-654968ea-6342-4ba6-8516-e6876730c798" released by "delete_snapshot" :: held 3.469s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:47 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-4a511e21-4ce8-4587-a3b4-6436790019ea tempest-ProjectMemberTests-811768835 None] Created reservations ['4ba5a0ab-bf23-477a-ab6d-51ef375d3480', '00bbc162-f345-47fd-a789-e66cffa931f8', '871e9635-4621-4dfd-b231-c05c0a72a99b', 'f3cae97e-0f33-48e5-ac3d-e7b594f93d4a'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:47 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0b04ebd4-91f4-4f19-984f-9ea7952bc490 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.info" returned: 0 in 0.717s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:47 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-0b04ebd4-91f4-4f19-984f-9ea7952bc490 tempest-ProjectReaderTests-302102808 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.info is being set with open permissions: ugo+rw Jul 07 22:16:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0b04ebd4-91f4-4f19-984f-9ea7952bc490 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:47 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.info Jul 07 22:16:47 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:47 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-4a511e21-4ce8-4587-a3b4-6436790019ea tempest-ProjectMemberTests-811768835 None] Delete snapshot completed successfully. Jul 07 22:16:47 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4a511e21-4ce8-4587-a3b4-6436790019ea tempest-ProjectMemberTests-811768835 None] Lock "cinder-2516b80c-c0f0-4e39-86af-743745c93303-delete_snapshot" released by "delete_snapshot" :: held 3.652s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:48 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0b04ebd4-91f4-4f19-984f-9ea7952bc490 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.info" returned: 0 in 0.644s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0b04ebd4-91f4-4f19-984f-9ea7952bc490 tempest-ProjectReaderTests-302102808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.880s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1849175656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d862ecf-236b-4cae-aef3-294fd6995e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34bb8bdabe5d43ada132cfe1fda4606c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:42Z,use_quota=True,user_id='edda5a3cad444e699fe974cd00dec740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Creating volume 6d862ecf-236b-4cae-aef3-294fd6995e72 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:16:48 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6d862ecf-236b-4cae-aef3-294fd6995e72 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c9d71a9d-2e76-4ae5-af5b-c86f6935036f tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-654968ea-6342-4ba6-8516-e6876730c798-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:48 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6d862ecf-236b-4cae-aef3-294fd6995e72 1073741824 Jul 07 22:16:48 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:48 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-0b04ebd4-91f4-4f19-984f-9ea7952bc490 tempest-ProjectReaderTests-302102808 None] Create snapshot completed successfully Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c9d71a9d-2e76-4ae5-af5b-c86f6935036f tempest-ProjectMemberTests-811768835 None] Lock "cinder-654968ea-6342-4ba6-8516-e6876730c798-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c9d71a9d-2e76-4ae5-af5b-c86f6935036f tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-654968ea-6342-4ba6-8516-e6876730c798" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c9d71a9d-2e76-4ae5-af5b-c86f6935036f tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-654968ea-6342-4ba6-8516-e6876730c798" acquired by "delete_volume" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[804efc86-e334-40c2-a26b-a2afc0ddabd2]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9d71a9d-2e76-4ae5-af5b-c86f6935036f tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:48 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798 Jul 07 22:16:48 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ac2c2852-12da-4f1a-8bbc-200f7f6baddf tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-b987ae3e-73c7-4c3e-a07c-977433d13b8d-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ac2c2852-12da-4f1a-8bbc-200f7f6baddf tempest-ProjectReaderTests-302102808 None] Lock "cinder-b987ae3e-73c7-4c3e-a07c-977433d13b8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ac2c2852-12da-4f1a-8bbc-200f7f6baddf tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-quobyte-b5066440-d8a2-4041-8621-88df61160834" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ac2c2852-12da-4f1a-8bbc-200f7f6baddf tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-b5066440-d8a2-4041-8621-88df61160834" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ac2c2852-12da-4f1a-8bbc-200f7f6baddf tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-quobyte-b987ae3e-73c7-4c3e-a07c-977433d13b8d" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ac2c2852-12da-4f1a-8bbc-200f7f6baddf tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-b987ae3e-73c7-4c3e-a07c-977433d13b8d" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-ac2c2852-12da-4f1a-8bbc-200f7f6baddf tempest-ProjectReaderTests-302102808 None] Deleting offline snapshot b987ae3e-73c7-4c3e-a07c-977433d13b8d of volume b5066440-d8a2-4041-8621-88df61160834 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-ac2c2852-12da-4f1a-8bbc-200f7f6baddf tempest-ProjectReaderTests-302102808 None] snapshot_file for this snap is: volume-b5066440-d8a2-4041-8621-88df61160834.b987ae3e-73c7-4c3e-a07c-977433d13b8d {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2b1f51-9962-4e19-92b2-ca2ab72565b4]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac2c2852-12da-4f1a-8bbc-200f7f6baddf tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.b987ae3e-73c7-4c3e-a07c-977433d13b8d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:48 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.b987ae3e-73c7-4c3e-a07c-977433d13b8d Jul 07 22:16:48 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:49 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6d862ecf-236b-4cae-aef3-294fd6995e72 1073741824" returned: 0 in 0.975s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6d862ecf-236b-4cae-aef3-294fd6995e72 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:49 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6d862ecf-236b-4cae-aef3-294fd6995e72 Jul 07 22:16:49 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:49 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9d71a9d-2e76-4ae5-af5b-c86f6935036f tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798" returned: 0 in 0.896s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9d71a9d-2e76-4ae5-af5b-c86f6935036f tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:49 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798 Jul 07 22:16:49 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:49 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac2c2852-12da-4f1a-8bbc-200f7f6baddf tempest-ProjectReaderTests-302102808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.b987ae3e-73c7-4c3e-a07c-977433d13b8d" returned: 0 in 0.965s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:49 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-ac2c2852-12da-4f1a-8bbc-200f7f6baddf tempest-ProjectReaderTests-302102808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5066440-d8a2-4041-8621-88df61160834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:16:49 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8298cac-07c5-46e9-b137-7a939b6cc296]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac2c2852-12da-4f1a-8bbc-200f7f6baddf tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:49 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834 Jul 07 22:16:49 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:49 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6d862ecf-236b-4cae-aef3-294fd6995e72" returned: 0 in 0.706s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:49 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:16:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113032c1-bd5d-47a3-83ff-01f413075418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d862ecf-236b-4cae-aef3-294fd6995e72', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (decd6a31-acad-4423-95a1-785118c1c45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:49 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9d71a9d-2e76-4ae5-af5b-c86f6935036f tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-654968ea-6342-4ba6-8516-e6876730c798" returned: 0 in 0.678s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:49 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Volume volume-6d862ecf-236b-4cae-aef3-294fd6995e72 (6d862ecf-236b-4cae-aef3-294fd6995e72): created successfully Jul 07 22:16:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (decd6a31-acad-4423-95a1-785118c1c45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:49 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Flow 'volume_create_manager' (52c3e4f4-7892-415b-a7cb-c2ae169fd02c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:49 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c9d71a9d-2e76-4ae5-af5b-c86f6935036f tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-654968ea-6342-4ba6-8516-e6876730c798" released by "delete_volume" :: held 1.668s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:49 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-9141b5c0-baec-4f27-a038-0ef4933f377a tempest-ProjectReaderTests-1910569980 None] Created volume successfully. Jul 07 22:16:50 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-c9d71a9d-2e76-4ae5-af5b-c86f6935036f tempest-ProjectMemberTests-811768835 None] Created reservations ['0f31af29-476e-4a09-a732-94d74d037c24', '92b8202c-32a4-499f-933a-b5a9e8bb50b6', 'fefd3d21-9da0-441e-8ff8-03afba675f38', '2b68e540-fb64-4a61-b6dd-d76b4e6e7e33'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9d71a9d-2e76-4ae5-af5b-c86f6935036f tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9d71a9d-2e76-4ae5-af5b-c86f6935036f tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9d71a9d-2e76-4ae5-af5b-c86f6935036f tempest-ProjectMemberTests-811768835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:50 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9d71a9d-2e76-4ae5-af5b-c86f6935036f tempest-ProjectMemberTests-811768835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9d71a9d-2e76-4ae5-af5b-c86f6935036f tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9d71a9d-2e76-4ae5-af5b-c86f6935036f tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:50 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:16:50 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:50 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac2c2852-12da-4f1a-8bbc-200f7f6baddf tempest-ProjectReaderTests-302102808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834" returned: 0 in 0.875s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac2c2852-12da-4f1a-8bbc-200f7f6baddf tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.b987ae3e-73c7-4c3e-a07c-977433d13b8d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:50 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.b987ae3e-73c7-4c3e-a07c-977433d13b8d Jul 07 22:16:50 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:50 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9d71a9d-2e76-4ae5-af5b-c86f6935036f tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.744s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:50 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9d71a9d-2e76-4ae5-af5b-c86f6935036f tempest-ProjectMemberTests-811768835 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:16:50 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-c9d71a9d-2e76-4ae5-af5b-c86f6935036f tempest-ProjectMemberTests-811768835 None] Deleted volume successfully. Jul 07 22:16:50 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-c9d71a9d-2e76-4ae5-af5b-c86f6935036f tempest-ProjectMemberTests-811768835 None] Lock "cinder-654968ea-6342-4ba6-8516-e6876730c798-delete_volume" released by "delete_volume" :: held 2.704s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5b024621-8688-40f0-975c-b91c8cfb87fc tempest-ProjectReaderTests-1910569980 None] Acquiring lock "cinder-6d862ecf-236b-4cae-aef3-294fd6995e72-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5b024621-8688-40f0-975c-b91c8cfb87fc tempest-ProjectReaderTests-1910569980 None] Lock "cinder-6d862ecf-236b-4cae-aef3-294fd6995e72-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5b024621-8688-40f0-975c-b91c8cfb87fc tempest-ProjectReaderTests-1910569980 None] Acquiring lock "cinder-quobyte-6d862ecf-236b-4cae-aef3-294fd6995e72" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5b024621-8688-40f0-975c-b91c8cfb87fc tempest-ProjectReaderTests-1910569980 None] Lock "cinder-quobyte-6d862ecf-236b-4cae-aef3-294fd6995e72" acquired by "delete_volume" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef44017-99d8-4214-b343-3847b489fdf4]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5b024621-8688-40f0-975c-b91c8cfb87fc tempest-ProjectReaderTests-1910569980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6d862ecf-236b-4cae-aef3-294fd6995e72 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:51 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6d862ecf-236b-4cae-aef3-294fd6995e72 Jul 07 22:16:51 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Flow 'volume_create_manager' (4d23b0f2-b1b6-4b3c-a370-b2870ebb479a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bcdf848-86ae-4ed8-bb6c-36e015dc58a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bcdf848-86ae-4ed8-bb6c-36e015dc58a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1868710631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f92234-2043-4c1d-9a8e-b97f3289f502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72ec43c2b314ec2b44c0cd84238b6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:51Z,use_quota=True,user_id='cc4275e59c51481badff6b228bedd03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80264abd-85bc-469c-8c0d-8ad20b672624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80264abd-85bc-469c-8c0d-8ad20b672624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a675b8-f767-43a4-83ae-fb8a6ce21c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a675b8-f767-43a4-83ae-fb8a6ce21c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80f92234-2043-4c1d-9a8e-b97f3289f502', 'volume_name': 'volume-80f92234-2043-4c1d-9a8e-b97f3289f502', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3216a43-fe0f-4cb5-8b2e-686b0cc1d3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3216a43-fe0f-4cb5-8b2e-686b0cc1d3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b00422cc-b72e-4b6c-a0e1-fb95c1b3566f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:51 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Volume 80f92234-2043-4c1d-9a8e-b97f3289f502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80f92234-2043-4c1d-9a8e-b97f3289f502', 'volume_size': 1} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1868710631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f92234-2043-4c1d-9a8e-b97f3289f502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72ec43c2b314ec2b44c0cd84238b6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:51Z,use_quota=True,user_id='cc4275e59c51481badff6b228bedd03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Creating volume 80f92234-2043-4c1d-9a8e-b97f3289f502 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:16:51 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:51 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502 1073741824 Jul 07 22:16:51 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:51 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac2c2852-12da-4f1a-8bbc-200f7f6baddf tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.b987ae3e-73c7-4c3e-a07c-977433d13b8d" returned: 0 in 0.967s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac2c2852-12da-4f1a-8bbc-200f7f6baddf tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.b987ae3e-73c7-4c3e-a07c-977433d13b8d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:51 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.b987ae3e-73c7-4c3e-a07c-977433d13b8d Jul 07 22:16:51 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:52 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5b024621-8688-40f0-975c-b91c8cfb87fc tempest-ProjectReaderTests-1910569980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6d862ecf-236b-4cae-aef3-294fd6995e72" returned: 0 in 0.881s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5b024621-8688-40f0-975c-b91c8cfb87fc tempest-ProjectReaderTests-1910569980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6d862ecf-236b-4cae-aef3-294fd6995e72 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:52 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6d862ecf-236b-4cae-aef3-294fd6995e72 Jul 07 22:16:52 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:52 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac2c2852-12da-4f1a-8bbc-200f7f6baddf tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834.b987ae3e-73c7-4c3e-a07c-977433d13b8d" returned: 0 in 0.773s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ac2c2852-12da-4f1a-8bbc-200f7f6baddf tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-b987ae3e-73c7-4c3e-a07c-977433d13b8d" released by "_delete_snapshot" :: held 3.719s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ac2c2852-12da-4f1a-8bbc-200f7f6baddf tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-b5066440-d8a2-4041-8621-88df61160834" released by "delete_snapshot" :: held 3.754s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:52 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-ac2c2852-12da-4f1a-8bbc-200f7f6baddf tempest-ProjectReaderTests-302102808 None] Created reservations ['759ab00b-eab8-4708-9a40-98891af9b266', '0b006be0-0753-427a-8731-1d66ae3d4d59', 'c835fb9d-e847-4631-ab14-018c835847e1', '3bbcec3d-f5d8-4037-9817-d5e2ecaca67a'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:52 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502 1073741824" returned: 0 in 0.990s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:52 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ac2c2852-12da-4f1a-8bbc-200f7f6baddf tempest-ProjectReaderTests-302102808 None] Delete snapshot completed successfully. Jul 07 22:16:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ac2c2852-12da-4f1a-8bbc-200f7f6baddf tempest-ProjectReaderTests-302102808 None] Lock "cinder-b987ae3e-73c7-4c3e-a07c-977433d13b8d-delete_snapshot" released by "delete_snapshot" :: held 3.956s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:52 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502 Jul 07 22:16:52 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:52 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5b024621-8688-40f0-975c-b91c8cfb87fc tempest-ProjectReaderTests-1910569980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6d862ecf-236b-4cae-aef3-294fd6995e72" returned: 0 in 0.795s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5b024621-8688-40f0-975c-b91c8cfb87fc tempest-ProjectReaderTests-1910569980 None] Lock "cinder-quobyte-6d862ecf-236b-4cae-aef3-294fd6995e72" released by "delete_volume" :: held 1.729s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-5b024621-8688-40f0-975c-b91c8cfb87fc tempest-ProjectReaderTests-1910569980 None] Created reservations ['2558e381-3e2e-4d7f-bfd5-9cd0ab43762c', 'f92d5cfb-8e3e-4ece-bb56-81511747fc86', '7d4e7e99-6acd-4912-867a-53ecce3d0382', 'b1b91697-30a2-42b2-a7b3-2429af51a4d5'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8832874b-b0fe-4035-8ab6-c8c25a65c239 tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-b5066440-d8a2-4041-8621-88df61160834-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8832874b-b0fe-4035-8ab6-c8c25a65c239 tempest-ProjectReaderTests-302102808 None] Lock "cinder-b5066440-d8a2-4041-8621-88df61160834-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5b024621-8688-40f0-975c-b91c8cfb87fc tempest-ProjectReaderTests-1910569980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5b024621-8688-40f0-975c-b91c8cfb87fc tempest-ProjectReaderTests-1910569980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5b024621-8688-40f0-975c-b91c8cfb87fc tempest-ProjectReaderTests-1910569980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-5b024621-8688-40f0-975c-b91c8cfb87fc tempest-ProjectReaderTests-1910569980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5b024621-8688-40f0-975c-b91c8cfb87fc tempest-ProjectReaderTests-1910569980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5b024621-8688-40f0-975c-b91c8cfb87fc tempest-ProjectReaderTests-1910569980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8832874b-b0fe-4035-8ab6-c8c25a65c239 tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-quobyte-b5066440-d8a2-4041-8621-88df61160834" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8832874b-b0fe-4035-8ab6-c8c25a65c239 tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-b5066440-d8a2-4041-8621-88df61160834" acquired by "delete_volume" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:53 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:16:53 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae39acf5-6420-47f8-8dad-7e1127d07be7]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8832874b-b0fe-4035-8ab6-c8c25a65c239 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:53 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502" returned: 0 in 0.795s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b00422cc-b72e-4b6c-a0e1-fb95c1b3566f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80f92234-2043-4c1d-9a8e-b97f3289f502', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f7e4ba-6210-4333-b88d-ea26f5bf4bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:53 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Volume volume-80f92234-2043-4c1d-9a8e-b97f3289f502 (80f92234-2043-4c1d-9a8e-b97f3289f502): created successfully Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f7e4ba-6210-4333-b88d-ea26f5bf4bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Flow 'volume_create_manager' (4d23b0f2-b1b6-4b3c-a370-b2870ebb479a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:53 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834 Jul 07 22:16:53 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:53 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-83fd5984-9e44-4597-9dae-3e879b352f5c tempest-ProjectMemberTests-811768835 None] Created volume successfully. Jul 07 22:16:53 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5b024621-8688-40f0-975c-b91c8cfb87fc tempest-ProjectReaderTests-1910569980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.699s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-5b024621-8688-40f0-975c-b91c8cfb87fc tempest-ProjectReaderTests-1910569980 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:16:53 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-5b024621-8688-40f0-975c-b91c8cfb87fc tempest-ProjectReaderTests-1910569980 None] Deleted volume successfully. Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-5b024621-8688-40f0-975c-b91c8cfb87fc tempest-ProjectReaderTests-1910569980 None] Lock "cinder-6d862ecf-236b-4cae-aef3-294fd6995e72-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:16:53 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Flow 'volume_create_manager' (f103c9a7-8738-455d-8441-1d24568fd29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c42d1f-dfb9-4e38-8699-ca2b0e30ccd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c42d1f-dfb9-4e38-8699-ca2b0e30ccd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1602432138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c67d19a-2931-4810-a45f-a3f23ca1eff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34bb8bdabe5d43ada132cfe1fda4606c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:54Z,use_quota=True,user_id='edda5a3cad444e699fe974cd00dec740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470239ea-bda7-4666-9f06-7ea72926831b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470239ea-bda7-4666-9f06-7ea72926831b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27bd1db6-48cf-4aea-b8d6-6ae609734e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27bd1db6-48cf-4aea-b8d6-6ae609734e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c67d19a-2931-4810-a45f-a3f23ca1eff1', 'volume_name': 'volume-6c67d19a-2931-4810-a45f-a3f23ca1eff1', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b0981f-261b-498b-9081-dfdc42b08e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b0981f-261b-498b-9081-dfdc42b08e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3cafedb-a577-4ef1-a0b8-a30a3dc80a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:54 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Volume 6c67d19a-2931-4810-a45f-a3f23ca1eff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c67d19a-2931-4810-a45f-a3f23ca1eff1', 'volume_size': 1} Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1602432138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c67d19a-2931-4810-a45f-a3f23ca1eff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34bb8bdabe5d43ada132cfe1fda4606c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:54Z,use_quota=True,user_id='edda5a3cad444e699fe974cd00dec740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Creating volume 6c67d19a-2931-4810-a45f-a3f23ca1eff1 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:16:54 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6c67d19a-2931-4810-a45f-a3f23ca1eff1 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:54 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6c67d19a-2931-4810-a45f-a3f23ca1eff1 1073741824 Jul 07 22:16:54 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:54 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8832874b-b0fe-4035-8ab6-c8c25a65c239 tempest-ProjectReaderTests-302102808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834" returned: 0 in 0.922s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8832874b-b0fe-4035-8ab6-c8c25a65c239 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:54 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834 Jul 07 22:16:54 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d85a2bef-7a75-4ff7-a426-4ef9df515b25 tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:54 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8832874b-b0fe-4035-8ab6-c8c25a65c239 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-b5066440-d8a2-4041-8621-88df61160834" returned: 0 in 0.726s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8832874b-b0fe-4035-8ab6-c8c25a65c239 tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-b5066440-d8a2-4041-8621-88df61160834" released by "delete_volume" :: held 1.716s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:54 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-8832874b-b0fe-4035-8ab6-c8c25a65c239 tempest-ProjectReaderTests-302102808 None] Created reservations ['a1e26d44-edab-46a9-a9e8-60d7e0bfe28d', '70740c16-da83-42d3-9277-a4a34065beaa', 'bcb89923-b6ee-4904-8108-5b594553392f', '8e7a9c7c-e543-472f-9dd8-8e4f38c0f9be'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8832874b-b0fe-4035-8ab6-c8c25a65c239 tempest-ProjectReaderTests-302102808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8832874b-b0fe-4035-8ab6-c8c25a65c239 tempest-ProjectReaderTests-302102808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8832874b-b0fe-4035-8ab6-c8c25a65c239 tempest-ProjectReaderTests-302102808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:55 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8832874b-b0fe-4035-8ab6-c8c25a65c239 tempest-ProjectReaderTests-302102808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8832874b-b0fe-4035-8ab6-c8c25a65c239 tempest-ProjectReaderTests-302102808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8832874b-b0fe-4035-8ab6-c8c25a65c239 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:55 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:16:55 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:55 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6c67d19a-2931-4810-a45f-a3f23ca1eff1 1073741824" returned: 0 in 1.113s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6c67d19a-2931-4810-a45f-a3f23ca1eff1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:55 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6c67d19a-2931-4810-a45f-a3f23ca1eff1 Jul 07 22:16:55 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:55 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8832874b-b0fe-4035-8ab6-c8c25a65c239 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.829s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:55 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-8832874b-b0fe-4035-8ab6-c8c25a65c239 tempest-ProjectReaderTests-302102808 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:16:55 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-8832874b-b0fe-4035-8ab6-c8c25a65c239 tempest-ProjectReaderTests-302102808 None] Deleted volume successfully. Jul 07 22:16:55 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8832874b-b0fe-4035-8ab6-c8c25a65c239 tempest-ProjectReaderTests-302102808 None] Lock "cinder-b5066440-d8a2-4041-8621-88df61160834-delete_volume" released by "delete_volume" :: held 2.825s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Flow 'volume_create_manager' (c8893907-f8f1-4b18-9d26-6181313afb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ac8dac-0285-4096-ac98-8fab78e0b476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ac8dac-0285-4096-ac98-8fab78e0b476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-594927670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68bfb63d-5d1c-458c-9bb0-d009be61fa5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d94796a104ca8b251257af621c466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:56Z,use_quota=True,user_id='bf6b56d5090a4d9c9d2578c8ecc98ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceec140d-557e-4948-95b0-5cb5235b260d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceec140d-557e-4948-95b0-5cb5235b260d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef20ee65-8544-42cc-b31b-8808c5147e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef20ee65-8544-42cc-b31b-8808c5147e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68bfb63d-5d1c-458c-9bb0-d009be61fa5f', 'volume_name': 'volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2125b46a-336f-4249-a2e3-a0823096ff08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2125b46a-336f-4249-a2e3-a0823096ff08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38cf6488-f68b-42db-bc85-44c60b6109b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:56 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Volume 68bfb63d-5d1c-458c-9bb0-d009be61fa5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f', 'volume_size': 1} Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:56 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6c67d19a-2931-4810-a45f-a3f23ca1eff1" returned: 0 in 0.899s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] <== create_volume: return (2073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.075s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d85a2bef-7a75-4ff7-a426-4ef9df515b25 tempest-ProjectMemberTests-811768835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.490s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-d85a2bef-7a75-4ff7-a426-4ef9df515b25 tempest-ProjectMemberTests-811768835 None] Creating offline snapshot 974e9401-8f11-4509-baf9-7377e6e3f840 of volume 80f92234-2043-4c1d-9a8e-b97f3289f502 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3cafedb-a577-4ef1-a0b8-a30a3dc80a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c67d19a-2931-4810-a45f-a3f23ca1eff1', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a8926d-d611-49f6-a643-0bb55ae31306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9f21e8-fdcf-4694-97f7-0c29ce188537]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d85a2bef-7a75-4ff7-a426-4ef9df515b25 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:56 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Volume volume-6c67d19a-2931-4810-a45f-a3f23ca1eff1 (6c67d19a-2931-4810-a45f-a3f23ca1eff1): created successfully Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a8926d-d611-49f6-a643-0bb55ae31306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:16:56 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Flow 'volume_create_manager' (f103c9a7-8738-455d-8441-1d24568fd29d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:16:56 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-2db374b4-7130-449c-9259-08bd296c411a tempest-ProjectReaderTests-1910569980 None] Created volume successfully. Jul 07 22:16:56 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502 Jul 07 22:16:56 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:57 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d85a2bef-7a75-4ff7-a426-4ef9df515b25 tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502" returned: 0 in 0.871s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d85a2bef-7a75-4ff7-a426-4ef9df515b25 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.974e9401-8f11-4509-baf9-7377e6e3f840 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:57 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.974e9401-8f11-4509-baf9-7377e6e3f840 1G Jul 07 22:16:57 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:57 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-69142e64-d335-4e3b-a12d-2f1f1ca4d215 tempest-ProjectReaderTests-1910569980 None] Acquiring lock "cinder-6c67d19a-2931-4810-a45f-a3f23ca1eff1-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:57 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-69142e64-d335-4e3b-a12d-2f1f1ca4d215 tempest-ProjectReaderTests-1910569980 None] Lock "cinder-6c67d19a-2931-4810-a45f-a3f23ca1eff1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:57 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-69142e64-d335-4e3b-a12d-2f1f1ca4d215 tempest-ProjectReaderTests-1910569980 None] Acquiring lock "cinder-quobyte-6c67d19a-2931-4810-a45f-a3f23ca1eff1" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:16:57 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-69142e64-d335-4e3b-a12d-2f1f1ca4d215 tempest-ProjectReaderTests-1910569980 None] Lock "cinder-quobyte-6c67d19a-2931-4810-a45f-a3f23ca1eff1" acquired by "delete_volume" :: waited 0.018s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:16:57 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[0311c08a-aa4a-4b1f-b606-04a7767b13b7]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:16:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69142e64-d335-4e3b-a12d-2f1f1ca4d215 tempest-ProjectReaderTests-1910569980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6c67d19a-2931-4810-a45f-a3f23ca1eff1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:57 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6c67d19a-2931-4810-a45f-a3f23ca1eff1 Jul 07 22:16:57 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:57 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d85a2bef-7a75-4ff7-a426-4ef9df515b25 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.974e9401-8f11-4509-baf9-7377e6e3f840 1G" returned: 0 in 0.921s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d85a2bef-7a75-4ff7-a426-4ef9df515b25 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80f92234-2043-4c1d-9a8e-b97f3289f502 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.974e9401-8f11-4509-baf9-7377e6e3f840 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:58 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80f92234-2043-4c1d-9a8e-b97f3289f502 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.974e9401-8f11-4509-baf9-7377e6e3f840 Jul 07 22:16:58 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:58 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69142e64-d335-4e3b-a12d-2f1f1ca4d215 tempest-ProjectReaderTests-1910569980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6c67d19a-2931-4810-a45f-a3f23ca1eff1" returned: 0 in 0.829s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69142e64-d335-4e3b-a12d-2f1f1ca4d215 tempest-ProjectReaderTests-1910569980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6c67d19a-2931-4810-a45f-a3f23ca1eff1 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:58 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6c67d19a-2931-4810-a45f-a3f23ca1eff1 Jul 07 22:16:58 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:58 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d85a2bef-7a75-4ff7-a426-4ef9df515b25 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80f92234-2043-4c1d-9a8e-b97f3289f502 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.974e9401-8f11-4509-baf9-7377e6e3f840" returned: 0 in 0.790s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:58 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-d85a2bef-7a75-4ff7-a426-4ef9df515b25 tempest-ProjectMemberTests-811768835 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.974e9401-8f11-4509-baf9-7377e6e3f840 is being set with open permissions: ugo+rw Jul 07 22:16:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d85a2bef-7a75-4ff7-a426-4ef9df515b25 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.974e9401-8f11-4509-baf9-7377e6e3f840 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:58 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.974e9401-8f11-4509-baf9-7377e6e3f840 Jul 07 22:16:58 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:58 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69142e64-d335-4e3b-a12d-2f1f1ca4d215 tempest-ProjectReaderTests-1910569980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-6c67d19a-2931-4810-a45f-a3f23ca1eff1" returned: 0 in 0.742s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:58 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-69142e64-d335-4e3b-a12d-2f1f1ca4d215 tempest-ProjectReaderTests-1910569980 None] Lock "cinder-quobyte-6c67d19a-2931-4810-a45f-a3f23ca1eff1" released by "delete_volume" :: held 1.636s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:16:58 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=169,cinder:INSERT=53,cinder:UPDATE=233,cinder:DELETE=12 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:16:58 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=164,cinder:INSERT=69,cinder:UPDATE=218,cinder:DELETE=25 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:16:58 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-69142e64-d335-4e3b-a12d-2f1f1ca4d215 tempest-ProjectReaderTests-1910569980 None] Created reservations ['44e283a5-1a15-407f-b369-a4734edb8af0', '01ce5b57-e7da-421c-b47f-8c2b305e3d22', '238ebd83-db5d-4c13-a19e-82eb4e1f5989', 'c2447b68-3d9b-4836-a546-2db6e34c0219'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:16:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-69142e64-d335-4e3b-a12d-2f1f1ca4d215 tempest-ProjectReaderTests-1910569980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:16:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-69142e64-d335-4e3b-a12d-2f1f1ca4d215 tempest-ProjectReaderTests-1910569980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:16:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-69142e64-d335-4e3b-a12d-2f1f1ca4d215 tempest-ProjectReaderTests-1910569980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:16:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-69142e64-d335-4e3b-a12d-2f1f1ca4d215 tempest-ProjectReaderTests-1910569980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:16:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-69142e64-d335-4e3b-a12d-2f1f1ca4d215 tempest-ProjectReaderTests-1910569980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:16:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69142e64-d335-4e3b-a12d-2f1f1ca4d215 tempest-ProjectReaderTests-1910569980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:59 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:16:59 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:59 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d85a2bef-7a75-4ff7-a426-4ef9df515b25 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.974e9401-8f11-4509-baf9-7377e6e3f840" returned: 0 in 0.783s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d85a2bef-7a75-4ff7-a426-4ef9df515b25 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:16:59 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.info Jul 07 22:16:59 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:16:59 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 07 22:16:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-69142e64-d335-4e3b-a12d-2f1f1ca4d215 tempest-ProjectReaderTests-1910569980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.723s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:16:59 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-69142e64-d335-4e3b-a12d-2f1f1ca4d215 tempest-ProjectReaderTests-1910569980 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:16:59 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-69142e64-d335-4e3b-a12d-2f1f1ca4d215 tempest-ProjectReaderTests-1910569980 None] Deleted volume successfully. Jul 07 22:16:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-69142e64-d335-4e3b-a12d-2f1f1ca4d215 tempest-ProjectReaderTests-1910569980 None] Lock "cinder-6c67d19a-2931-4810-a45f-a3f23ca1eff1-delete_volume" released by "delete_volume" :: held 2.632s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:00 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d85a2bef-7a75-4ff7-a426-4ef9df515b25 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.info" returned: 0 in 0.732s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:00 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-d85a2bef-7a75-4ff7-a426-4ef9df515b25 tempest-ProjectMemberTests-811768835 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.info is being set with open permissions: ugo+rw Jul 07 22:17:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d85a2bef-7a75-4ff7-a426-4ef9df515b25 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:00 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.info Jul 07 22:17:00 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:01 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d85a2bef-7a75-4ff7-a426-4ef9df515b25 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.info" returned: 0 in 0.736s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d85a2bef-7a75-4ff7-a426-4ef9df515b25 tempest-ProjectMemberTests-811768835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.986s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.042s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:01 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-594927670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68bfb63d-5d1c-458c-9bb0-d009be61fa5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d94796a104ca8b251257af621c466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:16:56Z,use_quota=True,user_id='bf6b56d5090a4d9c9d2578c8ecc98ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:17:01 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Creating volume 68bfb63d-5d1c-458c-9bb0-d009be61fa5f {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:17:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:01 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:17:01 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:17:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:01 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:17:01 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:17:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:01 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f 1073741824 Jul 07 22:17:01 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:01 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d85a2bef-7a75-4ff7-a426-4ef9df515b25 tempest-ProjectMemberTests-811768835 None] Create snapshot completed successfully Jul 07 22:17:01 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9b2a43cd-664d-4474-accd-d20e6392547e tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-974e9401-8f11-4509-baf9-7377e6e3f840-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9b2a43cd-664d-4474-accd-d20e6392547e tempest-ProjectMemberTests-811768835 None] Lock "cinder-974e9401-8f11-4509-baf9-7377e6e3f840-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9b2a43cd-664d-4474-accd-d20e6392547e tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-80f92234-2043-4c1d-9a8e-b97f3289f502" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9b2a43cd-664d-4474-accd-d20e6392547e tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-80f92234-2043-4c1d-9a8e-b97f3289f502" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9b2a43cd-664d-4474-accd-d20e6392547e tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-974e9401-8f11-4509-baf9-7377e6e3f840" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9b2a43cd-664d-4474-accd-d20e6392547e tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-974e9401-8f11-4509-baf9-7377e6e3f840" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-9b2a43cd-664d-4474-accd-d20e6392547e tempest-ProjectMemberTests-811768835 None] Deleting offline snapshot 974e9401-8f11-4509-baf9-7377e6e3f840 of volume 80f92234-2043-4c1d-9a8e-b97f3289f502 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:17:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-9b2a43cd-664d-4474-accd-d20e6392547e tempest-ProjectMemberTests-811768835 None] snapshot_file for this snap is: volume-80f92234-2043-4c1d-9a8e-b97f3289f502.974e9401-8f11-4509-baf9-7377e6e3f840 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:17:02 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a48982d-4178-448b-b342-8ba2b4a4894a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9b2a43cd-664d-4474-accd-d20e6392547e tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.974e9401-8f11-4509-baf9-7377e6e3f840 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:02 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.974e9401-8f11-4509-baf9-7377e6e3f840 Jul 07 22:17:02 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:02 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f 1073741824" returned: 0 in 1.183s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:02 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f Jul 07 22:17:02 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:02 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9b2a43cd-664d-4474-accd-d20e6392547e tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.974e9401-8f11-4509-baf9-7377e6e3f840" returned: 0 in 0.838s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:02 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-9b2a43cd-664d-4474-accd-d20e6392547e tempest-ProjectMemberTests-811768835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80f92234-2043-4c1d-9a8e-b97f3289f502(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:17:02 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03a12b1-e785-4336-8b06-a75644408d16]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9b2a43cd-664d-4474-accd-d20e6392547e tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:03 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f" returned: 0 in 0.628s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:17:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38cf6488-f68b-42db-bc85-44c60b6109b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec66f0b-0709-45ed-9f4b-e5bee3e960c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:03 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502 Jul 07 22:17:03 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:03 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Volume volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f (68bfb63d-5d1c-458c-9bb0-d009be61fa5f): created successfully Jul 07 22:17:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec66f0b-0709-45ed-9f4b-e5bee3e960c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:03 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Flow 'volume_create_manager' (c8893907-f8f1-4b18-9d26-6181313afb02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:17:03 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-60492ac2-275e-4123-86f3-ee0f54968b6a tempest-ProjectReaderTests-302102808 None] Created volume successfully. Jul 07 22:17:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-441f1790-d5e4-407e-9814-f68f98d75b17 tempest-ProjectReaderTests-302102808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-441f1790-d5e4-407e-9814-f68f98d75b17 tempest-ProjectReaderTests-302102808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:03 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-441f1790-d5e4-407e-9814-f68f98d75b17 tempest-ProjectReaderTests-302102808 None] Creating offline snapshot 88e1e827-d00d-49c1-9753-35b1c8de4b7c of volume 68bfb63d-5d1c-458c-9bb0-d009be61fa5f {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:17:03 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfef663c-8093-4361-b88f-75aa0d90af02]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-441f1790-d5e4-407e-9814-f68f98d75b17 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:03 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9b2a43cd-664d-4474-accd-d20e6392547e tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502" returned: 0 in 0.816s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9b2a43cd-664d-4474-accd-d20e6392547e tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.974e9401-8f11-4509-baf9-7377e6e3f840 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:03 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.974e9401-8f11-4509-baf9-7377e6e3f840 Jul 07 22:17:03 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:03 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f Jul 07 22:17:03 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:04 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:04 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-441f1790-d5e4-407e-9814-f68f98d75b17 tempest-ProjectReaderTests-302102808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f" returned: 0 in 0.796s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-441f1790-d5e4-407e-9814-f68f98d75b17 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.88e1e827-d00d-49c1-9753-35b1c8de4b7c 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9b2a43cd-664d-4474-accd-d20e6392547e tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.974e9401-8f11-4509-baf9-7377e6e3f840" returned: 0 in 0.790s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9b2a43cd-664d-4474-accd-d20e6392547e tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.974e9401-8f11-4509-baf9-7377e6e3f840 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:04 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.88e1e827-d00d-49c1-9753-35b1c8de4b7c 1G Jul 07 22:17:04 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:04 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.974e9401-8f11-4509-baf9-7377e6e3f840 Jul 07 22:17:04 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:05 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9b2a43cd-664d-4474-accd-d20e6392547e tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502.974e9401-8f11-4509-baf9-7377e6e3f840" returned: 0 in 0.647s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:05 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9b2a43cd-664d-4474-accd-d20e6392547e tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-974e9401-8f11-4509-baf9-7377e6e3f840" released by "_delete_snapshot" :: held 3.216s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:05 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9b2a43cd-664d-4474-accd-d20e6392547e tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-80f92234-2043-4c1d-9a8e-b97f3289f502" released by "delete_snapshot" :: held 3.241s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:05 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-9b2a43cd-664d-4474-accd-d20e6392547e tempest-ProjectMemberTests-811768835 None] Created reservations ['1d6c63c2-9adf-4a5d-88f3-38a5e8758160', '3855ce72-bc98-4e6d-b72a-dc55c60a6018', 'ec01f75c-a9f7-4237-b71b-837c8a11dab7', '20eacfb6-c002-49e0-993b-8b1abb80ca19'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:17:05 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-9b2a43cd-664d-4474-accd-d20e6392547e tempest-ProjectMemberTests-811768835 None] Delete snapshot completed successfully. Jul 07 22:17:05 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-9b2a43cd-664d-4474-accd-d20e6392547e tempest-ProjectMemberTests-811768835 None] Lock "cinder-974e9401-8f11-4509-baf9-7377e6e3f840-delete_snapshot" released by "delete_snapshot" :: held 3.383s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:05 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-441f1790-d5e4-407e-9814-f68f98d75b17 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.88e1e827-d00d-49c1-9753-35b1c8de4b7c 1G" returned: 0 in 0.837s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-441f1790-d5e4-407e-9814-f68f98d75b17 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.88e1e827-d00d-49c1-9753-35b1c8de4b7c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:05 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.88e1e827-d00d-49c1-9753-35b1c8de4b7c Jul 07 22:17:05 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:06 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-441f1790-d5e4-407e-9814-f68f98d75b17 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.88e1e827-d00d-49c1-9753-35b1c8de4b7c" returned: 0 in 0.663s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:06 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-441f1790-d5e4-407e-9814-f68f98d75b17 tempest-ProjectReaderTests-302102808 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.88e1e827-d00d-49c1-9753-35b1c8de4b7c is being set with open permissions: ugo+rw Jul 07 22:17:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-441f1790-d5e4-407e-9814-f68f98d75b17 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.88e1e827-d00d-49c1-9753-35b1c8de4b7c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:06 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.88e1e827-d00d-49c1-9753-35b1c8de4b7c Jul 07 22:17:06 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:06 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6d9a5ba8-b630-4bb9-91ef-de41245eefe4 tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-80f92234-2043-4c1d-9a8e-b97f3289f502-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:06 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6d9a5ba8-b630-4bb9-91ef-de41245eefe4 tempest-ProjectMemberTests-811768835 None] Lock "cinder-80f92234-2043-4c1d-9a8e-b97f3289f502-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:06 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6d9a5ba8-b630-4bb9-91ef-de41245eefe4 tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-80f92234-2043-4c1d-9a8e-b97f3289f502" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:06 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6d9a5ba8-b630-4bb9-91ef-de41245eefe4 tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-80f92234-2043-4c1d-9a8e-b97f3289f502" acquired by "delete_volume" :: waited 0.021s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:06 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[a583340e-f9aa-44c2-b28f-346b689ca4b5]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6d9a5ba8-b630-4bb9-91ef-de41245eefe4 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:06 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502 Jul 07 22:17:06 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:06 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-441f1790-d5e4-407e-9814-f68f98d75b17 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.88e1e827-d00d-49c1-9753-35b1c8de4b7c" returned: 0 in 0.817s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-441f1790-d5e4-407e-9814-f68f98d75b17 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:06 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.info Jul 07 22:17:06 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:07 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6d9a5ba8-b630-4bb9-91ef-de41245eefe4 tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502" returned: 0 in 0.786s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6d9a5ba8-b630-4bb9-91ef-de41245eefe4 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:07 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502 Jul 07 22:17:07 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:07 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-441f1790-d5e4-407e-9814-f68f98d75b17 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.info" returned: 0 in 0.740s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:07 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-441f1790-d5e4-407e-9814-f68f98d75b17 tempest-ProjectReaderTests-302102808 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.info is being set with open permissions: ugo+rw Jul 07 22:17:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-441f1790-d5e4-407e-9814-f68f98d75b17 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:07 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.info Jul 07 22:17:07 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:07 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6d9a5ba8-b630-4bb9-91ef-de41245eefe4 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-80f92234-2043-4c1d-9a8e-b97f3289f502" returned: 0 in 0.686s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:07 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6d9a5ba8-b630-4bb9-91ef-de41245eefe4 tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-80f92234-2043-4c1d-9a8e-b97f3289f502" released by "delete_volume" :: held 1.536s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:07 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-6d9a5ba8-b630-4bb9-91ef-de41245eefe4 tempest-ProjectMemberTests-811768835 None] Created reservations ['4a3df4d0-809e-485d-b45f-91b2c45eff50', '9afc3d78-2f8c-44b4-92f4-29f48971c91b', 'c6a6152b-9a7b-4d0d-bc8b-a84bbf175434', 'b9c732c6-72b1-43b1-b291-6f9b9a05c112'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:17:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6d9a5ba8-b630-4bb9-91ef-de41245eefe4 tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6d9a5ba8-b630-4bb9-91ef-de41245eefe4 tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6d9a5ba8-b630-4bb9-91ef-de41245eefe4 tempest-ProjectMemberTests-811768835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:17:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6d9a5ba8-b630-4bb9-91ef-de41245eefe4 tempest-ProjectMemberTests-811768835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:17:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6d9a5ba8-b630-4bb9-91ef-de41245eefe4 tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6d9a5ba8-b630-4bb9-91ef-de41245eefe4 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:08 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:17:08 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:08 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-441f1790-d5e4-407e-9814-f68f98d75b17 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.info" returned: 0 in 0.688s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-441f1790-d5e4-407e-9814-f68f98d75b17 tempest-ProjectReaderTests-302102808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.646s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:08 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-441f1790-d5e4-407e-9814-f68f98d75b17 tempest-ProjectReaderTests-302102808 None] Create snapshot completed successfully Jul 07 22:17:08 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6d9a5ba8-b630-4bb9-91ef-de41245eefe4 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.684s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:08 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-6d9a5ba8-b630-4bb9-91ef-de41245eefe4 tempest-ProjectMemberTests-811768835 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:17:08 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6d9a5ba8-b630-4bb9-91ef-de41245eefe4 tempest-ProjectMemberTests-811768835 None] Deleted volume successfully. Jul 07 22:17:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6d9a5ba8-b630-4bb9-91ef-de41245eefe4 tempest-ProjectMemberTests-811768835 None] Lock "cinder-80f92234-2043-4c1d-9a8e-b97f3289f502-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f211b0e9-a14a-453d-95c4-db2ae69cd0d9 tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-88e1e827-d00d-49c1-9753-35b1c8de4b7c-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f211b0e9-a14a-453d-95c4-db2ae69cd0d9 tempest-ProjectReaderTests-302102808 None] Lock "cinder-88e1e827-d00d-49c1-9753-35b1c8de4b7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:08 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f211b0e9-a14a-453d-95c4-db2ae69cd0d9 tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-quobyte-68bfb63d-5d1c-458c-9bb0-d009be61fa5f" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f211b0e9-a14a-453d-95c4-db2ae69cd0d9 tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-68bfb63d-5d1c-458c-9bb0-d009be61fa5f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f211b0e9-a14a-453d-95c4-db2ae69cd0d9 tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-quobyte-88e1e827-d00d-49c1-9753-35b1c8de4b7c" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Flow 'volume_create_manager' (62e6e573-39c8-4686-9cac-669e03629d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165045bb-0fc1-4e17-be56-ab1c127dbb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f211b0e9-a14a-453d-95c4-db2ae69cd0d9 tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-88e1e827-d00d-49c1-9753-35b1c8de4b7c" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-f211b0e9-a14a-453d-95c4-db2ae69cd0d9 tempest-ProjectReaderTests-302102808 None] Deleting offline snapshot 88e1e827-d00d-49c1-9753-35b1c8de4b7c of volume 68bfb63d-5d1c-458c-9bb0-d009be61fa5f {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-f211b0e9-a14a-453d-95c4-db2ae69cd0d9 tempest-ProjectReaderTests-302102808 None] snapshot_file for this snap is: volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.88e1e827-d00d-49c1-9753-35b1c8de4b7c {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165045bb-0fc1-4e17-be56-ab1c127dbb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1535722434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da560cc-5b9d-4319-9e0a-db67de3131d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72ec43c2b314ec2b44c0cd84238b6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:17:09Z,use_quota=True,user_id='cc4275e59c51481badff6b228bedd03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f53e2e76-9352-4a39-abfc-656dc44fbd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f53e2e76-9352-4a39-abfc-656dc44fbd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c822dec8-d28a-4fa2-aac6-5dd76351f540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c822dec8-d28a-4fa2-aac6-5dd76351f540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0da560cc-5b9d-4319-9e0a-db67de3131d7', 'volume_name': 'volume-0da560cc-5b9d-4319-9e0a-db67de3131d7', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0bc5ef-40a6-4d75-91ed-fc8a3b1b3950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0bc5ef-40a6-4d75-91ed-fc8a3b1b3950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41c21ae-e8c9-468c-b587-d48792d3bfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:09 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Volume 0da560cc-5b9d-4319-9e0a-db67de3131d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0da560cc-5b9d-4319-9e0a-db67de3131d7', 'volume_size': 1} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1535722434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da560cc-5b9d-4319-9e0a-db67de3131d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72ec43c2b314ec2b44c0cd84238b6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:17:09Z,use_quota=True,user_id='cc4275e59c51481badff6b228bedd03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Creating volume 0da560cc-5b9d-4319-9e0a-db67de3131d7 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:17:09 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[effeabc1-52da-4ad0-a9e6-611f42b0c6dd]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f211b0e9-a14a-453d-95c4-db2ae69cd0d9 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.88e1e827-d00d-49c1-9753-35b1c8de4b7c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:09 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7 1073741824 Jul 07 22:17:09 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:09 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.88e1e827-d00d-49c1-9753-35b1c8de4b7c Jul 07 22:17:09 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:09 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f211b0e9-a14a-453d-95c4-db2ae69cd0d9 tempest-ProjectReaderTests-302102808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.88e1e827-d00d-49c1-9753-35b1c8de4b7c" returned: 0 in 0.799s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-f211b0e9-a14a-453d-95c4-db2ae69cd0d9 tempest-ProjectReaderTests-302102808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d606aa-77c3-4ad5-83b3-732bceb18a71]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f211b0e9-a14a-453d-95c4-db2ae69cd0d9 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:09 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7 1073741824" returned: 0 in 0.851s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:10 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7 Jul 07 22:17:10 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:10 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f Jul 07 22:17:10 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:10 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f211b0e9-a14a-453d-95c4-db2ae69cd0d9 tempest-ProjectReaderTests-302102808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f" returned: 0 in 0.772s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f211b0e9-a14a-453d-95c4-db2ae69cd0d9 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.88e1e827-d00d-49c1-9753-35b1c8de4b7c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:10 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.88e1e827-d00d-49c1-9753-35b1c8de4b7c Jul 07 22:17:10 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:10 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7" returned: 0 in 0.754s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:10 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:17:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41c21ae-e8c9-468c-b587-d48792d3bfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0da560cc-5b9d-4319-9e0a-db67de3131d7', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734cb470-10bd-4e25-87e5-f762d0905dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:10 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Volume volume-0da560cc-5b9d-4319-9e0a-db67de3131d7 (0da560cc-5b9d-4319-9e0a-db67de3131d7): created successfully Jul 07 22:17:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734cb470-10bd-4e25-87e5-f762d0905dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:10 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Flow 'volume_create_manager' (62e6e573-39c8-4686-9cac-669e03629d64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:17:10 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-964bb149-b59f-4c11-9fba-862fd1906549 tempest-ProjectMemberTests-811768835 None] Created volume successfully. Jul 07 22:17:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c8c87c9b-689d-4897-ad02-db3ec9a1f33b tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c8c87c9b-689d-4897-ad02-db3ec9a1f33b tempest-ProjectMemberTests-811768835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:11 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-c8c87c9b-689d-4897-ad02-db3ec9a1f33b tempest-ProjectMemberTests-811768835 None] Creating offline snapshot e76723dc-a816-4ef0-989d-800a7ca1c4b8 of volume 0da560cc-5b9d-4319-9e0a-db67de3131d7 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:17:11 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f49172-cea8-410e-bc59-32928cc84622]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c8c87c9b-689d-4897-ad02-db3ec9a1f33b tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:11 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7 Jul 07 22:17:11 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:11 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f211b0e9-a14a-453d-95c4-db2ae69cd0d9 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.88e1e827-d00d-49c1-9753-35b1c8de4b7c" returned: 0 in 0.747s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f211b0e9-a14a-453d-95c4-db2ae69cd0d9 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.88e1e827-d00d-49c1-9753-35b1c8de4b7c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:11 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.88e1e827-d00d-49c1-9753-35b1c8de4b7c Jul 07 22:17:11 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:12 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c8c87c9b-689d-4897-ad02-db3ec9a1f33b tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7" returned: 0 in 0.826s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c8c87c9b-689d-4897-ad02-db3ec9a1f33b tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.e76723dc-a816-4ef0-989d-800a7ca1c4b8 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:12 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-f211b0e9-a14a-453d-95c4-db2ae69cd0d9 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f.88e1e827-d00d-49c1-9753-35b1c8de4b7c" returned: 0 in 0.644s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:12 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.e76723dc-a816-4ef0-989d-800a7ca1c4b8 1G Jul 07 22:17:12 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:12 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f211b0e9-a14a-453d-95c4-db2ae69cd0d9 tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-88e1e827-d00d-49c1-9753-35b1c8de4b7c" released by "_delete_snapshot" :: held 3.119s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:12 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f211b0e9-a14a-453d-95c4-db2ae69cd0d9 tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-68bfb63d-5d1c-458c-9bb0-d009be61fa5f" released by "delete_snapshot" :: held 3.179s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:12 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-f211b0e9-a14a-453d-95c4-db2ae69cd0d9 tempest-ProjectReaderTests-302102808 None] Created reservations ['810aaff9-2c3b-423f-9ad0-c4396015f12e', 'e386aab8-4360-4b18-a8f1-1007d9df3fa4', '91d9f657-60cb-4436-9a9c-60687a0e2eda', 'a915f130-5204-4dda-9eaa-06a6936e24ef'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:17:12 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-f211b0e9-a14a-453d-95c4-db2ae69cd0d9 tempest-ProjectReaderTests-302102808 None] Delete snapshot completed successfully. Jul 07 22:17:12 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-f211b0e9-a14a-453d-95c4-db2ae69cd0d9 tempest-ProjectReaderTests-302102808 None] Lock "cinder-88e1e827-d00d-49c1-9753-35b1c8de4b7c-delete_snapshot" released by "delete_snapshot" :: held 3.359s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:12 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c8c87c9b-689d-4897-ad02-db3ec9a1f33b tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.e76723dc-a816-4ef0-989d-800a7ca1c4b8 1G" returned: 0 in 0.803s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c8c87c9b-689d-4897-ad02-db3ec9a1f33b tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da560cc-5b9d-4319-9e0a-db67de3131d7 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.e76723dc-a816-4ef0-989d-800a7ca1c4b8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:12 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da560cc-5b9d-4319-9e0a-db67de3131d7 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.e76723dc-a816-4ef0-989d-800a7ca1c4b8 Jul 07 22:17:12 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fe052a37-8bc4-48d7-b6b1-c1fe3f4073eb tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-68bfb63d-5d1c-458c-9bb0-d009be61fa5f-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fe052a37-8bc4-48d7-b6b1-c1fe3f4073eb tempest-ProjectReaderTests-302102808 None] Lock "cinder-68bfb63d-5d1c-458c-9bb0-d009be61fa5f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fe052a37-8bc4-48d7-b6b1-c1fe3f4073eb tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-quobyte-68bfb63d-5d1c-458c-9bb0-d009be61fa5f" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fe052a37-8bc4-48d7-b6b1-c1fe3f4073eb tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-68bfb63d-5d1c-458c-9bb0-d009be61fa5f" acquired by "delete_volume" :: waited 0.022s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:13 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dec6a2f-fda8-4fa3-bb74-b173c320828f]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fe052a37-8bc4-48d7-b6b1-c1fe3f4073eb tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:13 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f Jul 07 22:17:13 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:13 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c8c87c9b-689d-4897-ad02-db3ec9a1f33b tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da560cc-5b9d-4319-9e0a-db67de3131d7 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.e76723dc-a816-4ef0-989d-800a7ca1c4b8" returned: 0 in 0.700s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:13 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-c8c87c9b-689d-4897-ad02-db3ec9a1f33b tempest-ProjectMemberTests-811768835 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.e76723dc-a816-4ef0-989d-800a7ca1c4b8 is being set with open permissions: ugo+rw Jul 07 22:17:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c8c87c9b-689d-4897-ad02-db3ec9a1f33b tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.e76723dc-a816-4ef0-989d-800a7ca1c4b8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:13 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.e76723dc-a816-4ef0-989d-800a7ca1c4b8 Jul 07 22:17:13 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:14 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fe052a37-8bc4-48d7-b6b1-c1fe3f4073eb tempest-ProjectReaderTests-302102808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f" returned: 0 in 0.761s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fe052a37-8bc4-48d7-b6b1-c1fe3f4073eb tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:14 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f Jul 07 22:17:14 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:14 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c8c87c9b-689d-4897-ad02-db3ec9a1f33b tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.e76723dc-a816-4ef0-989d-800a7ca1c4b8" returned: 0 in 0.658s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c8c87c9b-689d-4897-ad02-db3ec9a1f33b tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:14 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.info Jul 07 22:17:14 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:14 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fe052a37-8bc4-48d7-b6b1-c1fe3f4073eb tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-68bfb63d-5d1c-458c-9bb0-d009be61fa5f" returned: 0 in 0.623s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:14 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fe052a37-8bc4-48d7-b6b1-c1fe3f4073eb tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-68bfb63d-5d1c-458c-9bb0-d009be61fa5f" released by "delete_volume" :: held 1.461s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:14 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-fe052a37-8bc4-48d7-b6b1-c1fe3f4073eb tempest-ProjectReaderTests-302102808 None] Created reservations ['d27a73e6-8ced-4de6-b52c-8ba6cfc3488e', '762e341b-b755-4d3e-b6b5-28e5620e12db', '2f990de1-6718-4b8c-a5e8-3f90ce3fc4e5', 'b40ebb38-a4a6-4426-a043-5e3e4b2a80f6'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:17:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-fe052a37-8bc4-48d7-b6b1-c1fe3f4073eb tempest-ProjectReaderTests-302102808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-fe052a37-8bc4-48d7-b6b1-c1fe3f4073eb tempest-ProjectReaderTests-302102808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-fe052a37-8bc4-48d7-b6b1-c1fe3f4073eb tempest-ProjectReaderTests-302102808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:17:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-fe052a37-8bc4-48d7-b6b1-c1fe3f4073eb tempest-ProjectReaderTests-302102808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:17:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-fe052a37-8bc4-48d7-b6b1-c1fe3f4073eb tempest-ProjectReaderTests-302102808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fe052a37-8bc4-48d7-b6b1-c1fe3f4073eb tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:14 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:17:14 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:14 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c8c87c9b-689d-4897-ad02-db3ec9a1f33b tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.info" returned: 0 in 0.644s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:14 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-c8c87c9b-689d-4897-ad02-db3ec9a1f33b tempest-ProjectMemberTests-811768835 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.info is being set with open permissions: ugo+rw Jul 07 22:17:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c8c87c9b-689d-4897-ad02-db3ec9a1f33b tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:14 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.info Jul 07 22:17:14 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:15 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c8c87c9b-689d-4897-ad02-db3ec9a1f33b tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.info" returned: 0 in 0.618s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:15 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c8c87c9b-689d-4897-ad02-db3ec9a1f33b tempest-ProjectMemberTests-811768835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.351s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fe052a37-8bc4-48d7-b6b1-c1fe3f4073eb tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.736s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:15 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-fe052a37-8bc4-48d7-b6b1-c1fe3f4073eb tempest-ProjectReaderTests-302102808 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:17:15 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-fe052a37-8bc4-48d7-b6b1-c1fe3f4073eb tempest-ProjectReaderTests-302102808 None] Deleted volume successfully. Jul 07 22:17:15 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-c8c87c9b-689d-4897-ad02-db3ec9a1f33b tempest-ProjectMemberTests-811768835 None] Create snapshot completed successfully Jul 07 22:17:15 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-fe052a37-8bc4-48d7-b6b1-c1fe3f4073eb tempest-ProjectReaderTests-302102808 None] Lock "cinder-68bfb63d-5d1c-458c-9bb0-d009be61fa5f-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:15 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:17:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Flow 'volume_create_manager' (96026f70-88fa-410b-ab24-67f953e919a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:17:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e160113-3397-4ba9-9da3-de5dd1380ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e160113-3397-4ba9-9da3-de5dd1380ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-845095994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa9a18d-c07b-4190-8374-d69fbb0e46b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d94796a104ca8b251257af621c466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:17:16Z,use_quota=True,user_id='bf6b56d5090a4d9c9d2578c8ecc98ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00aee44b-f000-4fbe-b5b6-fb3aeadb8fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:15 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00aee44b-f000-4fbe-b5b6-fb3aeadb8fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7608eb6-0fa9-4445-8ea4-be1d593c15a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7608eb6-0fa9-4445-8ea4-be1d593c15a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fa9a18d-c07b-4190-8374-d69fbb0e46b8', 'volume_name': 'volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba3b0ea-deab-4cb2-b914-1e971e638ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba3b0ea-deab-4cb2-b914-1e971e638ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3526bc0-89dc-4267-bad5-d4ea3af7471b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:16 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Volume 9fa9a18d-c07b-4190-8374-d69fbb0e46b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8', 'volume_size': 1} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-845095994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa9a18d-c07b-4190-8374-d69fbb0e46b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d94796a104ca8b251257af621c466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:17:16Z,use_quota=True,user_id='bf6b56d5090a4d9c9d2578c8ecc98ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Creating volume 9fa9a18d-c07b-4190-8374-d69fbb0e46b8 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:17:16 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:16 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8 1073741824 Jul 07 22:17:16 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0c347e2f-765c-4c79-9596-6f4f841ca1cd tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-e76723dc-a816-4ef0-989d-800a7ca1c4b8-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0c347e2f-765c-4c79-9596-6f4f841ca1cd tempest-ProjectMemberTests-811768835 None] Lock "cinder-e76723dc-a816-4ef0-989d-800a7ca1c4b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0c347e2f-765c-4c79-9596-6f4f841ca1cd tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-0da560cc-5b9d-4319-9e0a-db67de3131d7" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0c347e2f-765c-4c79-9596-6f4f841ca1cd tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-0da560cc-5b9d-4319-9e0a-db67de3131d7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0c347e2f-765c-4c79-9596-6f4f841ca1cd tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-e76723dc-a816-4ef0-989d-800a7ca1c4b8" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0c347e2f-765c-4c79-9596-6f4f841ca1cd tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-e76723dc-a816-4ef0-989d-800a7ca1c4b8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-0c347e2f-765c-4c79-9596-6f4f841ca1cd tempest-ProjectMemberTests-811768835 None] Deleting offline snapshot e76723dc-a816-4ef0-989d-800a7ca1c4b8 of volume 0da560cc-5b9d-4319-9e0a-db67de3131d7 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-0c347e2f-765c-4c79-9596-6f4f841ca1cd tempest-ProjectMemberTests-811768835 None] snapshot_file for this snap is: volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.e76723dc-a816-4ef0-989d-800a7ca1c4b8 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[79444907-2812-4eb2-b486-1f94378c7cac]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0c347e2f-765c-4c79-9596-6f4f841ca1cd tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.e76723dc-a816-4ef0-989d-800a7ca1c4b8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:16 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.e76723dc-a816-4ef0-989d-800a7ca1c4b8 Jul 07 22:17:16 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:16 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8 1073741824" returned: 0 in 0.834s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:16 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8 Jul 07 22:17:16 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:17 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0c347e2f-765c-4c79-9596-6f4f841ca1cd tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.e76723dc-a816-4ef0-989d-800a7ca1c4b8" returned: 0 in 0.800s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:17 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-0c347e2f-765c-4c79-9596-6f4f841ca1cd tempest-ProjectMemberTests-811768835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0da560cc-5b9d-4319-9e0a-db67de3131d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:17:17 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99695ea-fe05-4437-8e0d-da44c2a2e201]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0c347e2f-765c-4c79-9596-6f4f841ca1cd tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:17 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7 Jul 07 22:17:17 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:17 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8" returned: 0 in 0.684s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:17 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:17:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3526bc0-89dc-4267-bad5-d4ea3af7471b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdde8d06-a390-4520-92a3-cd5d7815e9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:17 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Volume volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8 (9fa9a18d-c07b-4190-8374-d69fbb0e46b8): created successfully Jul 07 22:17:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdde8d06-a390-4520-92a3-cd5d7815e9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:17 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Flow 'volume_create_manager' (96026f70-88fa-410b-ab24-67f953e919a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:17:17 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d5c1f468-3a41-4071-aeef-efbcd87be4b2 tempest-ProjectReaderTests-302102808 None] Created volume successfully. Jul 07 22:17:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-fb0aa065-5363-4876-a80a-dcd9d69ddfc7 tempest-ProjectReaderTests-302102808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-fb0aa065-5363-4876-a80a-dcd9d69ddfc7 tempest-ProjectReaderTests-302102808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-fb0aa065-5363-4876-a80a-dcd9d69ddfc7 tempest-ProjectReaderTests-302102808 None] Creating offline snapshot 968d9bd7-ff9d-43ef-bdb3-a373968b26d4 of volume 9fa9a18d-c07b-4190-8374-d69fbb0e46b8 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:17:18 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd9bdf4-2112-4a4a-afc5-af698b3497eb]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fb0aa065-5363-4876-a80a-dcd9d69ddfc7 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:18 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0c347e2f-765c-4c79-9596-6f4f841ca1cd tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7" returned: 0 in 0.801s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0c347e2f-765c-4c79-9596-6f4f841ca1cd tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.e76723dc-a816-4ef0-989d-800a7ca1c4b8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:18 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.e76723dc-a816-4ef0-989d-800a7ca1c4b8 Jul 07 22:17:18 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:18 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8 Jul 07 22:17:18 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:19 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fb0aa065-5363-4876-a80a-dcd9d69ddfc7 tempest-ProjectReaderTests-302102808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8" returned: 0 in 0.841s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fb0aa065-5363-4876-a80a-dcd9d69ddfc7 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.968d9bd7-ff9d-43ef-bdb3-a373968b26d4 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:19 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0c347e2f-765c-4c79-9596-6f4f841ca1cd tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.e76723dc-a816-4ef0-989d-800a7ca1c4b8" returned: 0 in 0.810s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0c347e2f-765c-4c79-9596-6f4f841ca1cd tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.e76723dc-a816-4ef0-989d-800a7ca1c4b8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:19 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.968d9bd7-ff9d-43ef-bdb3-a373968b26d4 1G Jul 07 22:17:19 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:19 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.e76723dc-a816-4ef0-989d-800a7ca1c4b8 Jul 07 22:17:19 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:19 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0c347e2f-765c-4c79-9596-6f4f841ca1cd tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7.e76723dc-a816-4ef0-989d-800a7ca1c4b8" returned: 0 in 0.661s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0c347e2f-765c-4c79-9596-6f4f841ca1cd tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-e76723dc-a816-4ef0-989d-800a7ca1c4b8" released by "_delete_snapshot" :: held 3.168s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0c347e2f-765c-4c79-9596-6f4f841ca1cd tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-0da560cc-5b9d-4319-9e0a-db67de3131d7" released by "delete_snapshot" :: held 3.191s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:19 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-0c347e2f-765c-4c79-9596-6f4f841ca1cd tempest-ProjectMemberTests-811768835 None] Created reservations ['b1ce4fea-7e8f-4175-a4c7-a61e13c4d0a3', '7a12f163-6913-4f05-8ec3-5accb2cdb56b', 'e1243c7c-a74c-4b01-9a51-1d3ba0643f92', '163f5326-8b9b-4fb2-930c-078b385908e2'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:17:19 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-0c347e2f-765c-4c79-9596-6f4f841ca1cd tempest-ProjectMemberTests-811768835 None] Delete snapshot completed successfully. Jul 07 22:17:19 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0c347e2f-765c-4c79-9596-6f4f841ca1cd tempest-ProjectMemberTests-811768835 None] Lock "cinder-e76723dc-a816-4ef0-989d-800a7ca1c4b8-delete_snapshot" released by "delete_snapshot" :: held 3.355s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:19 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fb0aa065-5363-4876-a80a-dcd9d69ddfc7 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.968d9bd7-ff9d-43ef-bdb3-a373968b26d4 1G" returned: 0 in 0.907s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fb0aa065-5363-4876-a80a-dcd9d69ddfc7 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.968d9bd7-ff9d-43ef-bdb3-a373968b26d4 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:19 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.968d9bd7-ff9d-43ef-bdb3-a373968b26d4 Jul 07 22:17:19 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:20 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fb0aa065-5363-4876-a80a-dcd9d69ddfc7 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.968d9bd7-ff9d-43ef-bdb3-a373968b26d4" returned: 0 in 0.677s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:20 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-fb0aa065-5363-4876-a80a-dcd9d69ddfc7 tempest-ProjectReaderTests-302102808 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.968d9bd7-ff9d-43ef-bdb3-a373968b26d4 is being set with open permissions: ugo+rw Jul 07 22:17:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fb0aa065-5363-4876-a80a-dcd9d69ddfc7 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.968d9bd7-ff9d-43ef-bdb3-a373968b26d4 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:20 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.968d9bd7-ff9d-43ef-bdb3-a373968b26d4 Jul 07 22:17:20 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1f76db16-6fb8-44fe-84c8-ceec9a638a6a tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-0da560cc-5b9d-4319-9e0a-db67de3131d7-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1f76db16-6fb8-44fe-84c8-ceec9a638a6a tempest-ProjectMemberTests-811768835 None] Lock "cinder-0da560cc-5b9d-4319-9e0a-db67de3131d7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1f76db16-6fb8-44fe-84c8-ceec9a638a6a tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-0da560cc-5b9d-4319-9e0a-db67de3131d7" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:20 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1f76db16-6fb8-44fe-84c8-ceec9a638a6a tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-0da560cc-5b9d-4319-9e0a-db67de3131d7" acquired by "delete_volume" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:20 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1fad7a-6f64-443a-bd86-bc7264085da7]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1f76db16-6fb8-44fe-84c8-ceec9a638a6a tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:21 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7 Jul 07 22:17:21 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:21 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fb0aa065-5363-4876-a80a-dcd9d69ddfc7 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.968d9bd7-ff9d-43ef-bdb3-a373968b26d4" returned: 0 in 0.682s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fb0aa065-5363-4876-a80a-dcd9d69ddfc7 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:21 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.info Jul 07 22:17:21 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:21 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1f76db16-6fb8-44fe-84c8-ceec9a638a6a tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7" returned: 0 in 0.770s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1f76db16-6fb8-44fe-84c8-ceec9a638a6a tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:21 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7 Jul 07 22:17:21 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:22 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fb0aa065-5363-4876-a80a-dcd9d69ddfc7 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.info" returned: 0 in 0.724s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:22 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-fb0aa065-5363-4876-a80a-dcd9d69ddfc7 tempest-ProjectReaderTests-302102808 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.info is being set with open permissions: ugo+rw Jul 07 22:17:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fb0aa065-5363-4876-a80a-dcd9d69ddfc7 tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:22 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.info Jul 07 22:17:22 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:22 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1f76db16-6fb8-44fe-84c8-ceec9a638a6a tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-0da560cc-5b9d-4319-9e0a-db67de3131d7" returned: 0 in 0.652s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1f76db16-6fb8-44fe-84c8-ceec9a638a6a tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-0da560cc-5b9d-4319-9e0a-db67de3131d7" released by "delete_volume" :: held 1.488s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:22 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-1f76db16-6fb8-44fe-84c8-ceec9a638a6a tempest-ProjectMemberTests-811768835 None] Created reservations ['4aeb6419-bb80-4ad8-9e99-c6cf5159f306', '05d73f5b-2761-4a83-875f-97a91f2f32dd', 'e0100bfa-bd0f-4f47-b3c9-f17af808c477', 'c65f5460-1383-4338-b18c-439f7c26871b'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:17:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1f76db16-6fb8-44fe-84c8-ceec9a638a6a tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1f76db16-6fb8-44fe-84c8-ceec9a638a6a tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1f76db16-6fb8-44fe-84c8-ceec9a638a6a tempest-ProjectMemberTests-811768835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:17:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1f76db16-6fb8-44fe-84c8-ceec9a638a6a tempest-ProjectMemberTests-811768835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:17:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1f76db16-6fb8-44fe-84c8-ceec9a638a6a tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1f76db16-6fb8-44fe-84c8-ceec9a638a6a tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:22 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:17:22 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:22 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-fb0aa065-5363-4876-a80a-dcd9d69ddfc7 tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.info" returned: 0 in 0.682s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-fb0aa065-5363-4876-a80a-dcd9d69ddfc7 tempest-ProjectReaderTests-302102808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.606s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:22 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-fb0aa065-5363-4876-a80a-dcd9d69ddfc7 tempest-ProjectReaderTests-302102808 None] Create snapshot completed successfully Jul 07 22:17:23 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1f76db16-6fb8-44fe-84c8-ceec9a638a6a tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.694s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-1f76db16-6fb8-44fe-84c8-ceec9a638a6a tempest-ProjectMemberTests-811768835 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:17:23 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-1f76db16-6fb8-44fe-84c8-ceec9a638a6a tempest-ProjectMemberTests-811768835 None] Deleted volume successfully. Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1f76db16-6fb8-44fe-84c8-ceec9a638a6a tempest-ProjectMemberTests-811768835 None] Lock "cinder-0da560cc-5b9d-4319-9e0a-db67de3131d7-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4daa5805-dfb1-442f-a451-95510fe8c99f tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-968d9bd7-ff9d-43ef-bdb3-a373968b26d4-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4daa5805-dfb1-442f-a451-95510fe8c99f tempest-ProjectReaderTests-302102808 None] Lock "cinder-968d9bd7-ff9d-43ef-bdb3-a373968b26d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4daa5805-dfb1-442f-a451-95510fe8c99f tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-quobyte-9fa9a18d-c07b-4190-8374-d69fbb0e46b8" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4daa5805-dfb1-442f-a451-95510fe8c99f tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-9fa9a18d-c07b-4190-8374-d69fbb0e46b8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4daa5805-dfb1-442f-a451-95510fe8c99f tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-quobyte-968d9bd7-ff9d-43ef-bdb3-a373968b26d4" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4daa5805-dfb1-442f-a451-95510fe8c99f tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-968d9bd7-ff9d-43ef-bdb3-a373968b26d4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-4daa5805-dfb1-442f-a451-95510fe8c99f tempest-ProjectReaderTests-302102808 None] Deleting offline snapshot 968d9bd7-ff9d-43ef-bdb3-a373968b26d4 of volume 9fa9a18d-c07b-4190-8374-d69fbb0e46b8 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-4daa5805-dfb1-442f-a451-95510fe8c99f tempest-ProjectReaderTests-302102808 None] snapshot_file for this snap is: volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.968d9bd7-ff9d-43ef-bdb3-a373968b26d4 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[82242bd4-3038-4af2-a5e4-161085f463a7]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4daa5805-dfb1-442f-a451-95510fe8c99f tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.968d9bd7-ff9d-43ef-bdb3-a373968b26d4 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Flow 'volume_create_manager' (6290dfcf-df49-4247-87f8-aff5d37b5049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72e7219-afe9-4679-b718-7726be109d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72e7219-afe9-4679-b718-7726be109d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-387204668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e6aac97-46d5-4609-9c60-2fea8a9b53a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72ec43c2b314ec2b44c0cd84238b6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:17:23Z,use_quota=True,user_id='cc4275e59c51481badff6b228bedd03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75a575f-393e-4770-a0e2-e17b056bf0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75a575f-393e-4770-a0e2-e17b056bf0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (784b68e0-59c5-465b-95cc-87ae1610ae42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (784b68e0-59c5-465b-95cc-87ae1610ae42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e6aac97-46d5-4609-9c60-2fea8a9b53a3', 'volume_name': 'volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e85b2f-2530-4d4b-88e1-f7c0967cec4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e85b2f-2530-4d4b-88e1-f7c0967cec4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faec25b1-8550-46b6-9fb4-fa9ce0410988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:23 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Volume 7e6aac97-46d5-4609-9c60-2fea8a9b53a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3', 'volume_size': 1} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-387204668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e6aac97-46d5-4609-9c60-2fea8a9b53a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72ec43c2b314ec2b44c0cd84238b6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:17:23Z,use_quota=True,user_id='cc4275e59c51481badff6b228bedd03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Creating volume 7e6aac97-46d5-4609-9c60-2fea8a9b53a3 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:23 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.968d9bd7-ff9d-43ef-bdb3-a373968b26d4 Jul 07 22:17:23 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:17:23 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:17:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:23 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3 1073741824 Jul 07 22:17:23 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:24 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4daa5805-dfb1-442f-a451-95510fe8c99f tempest-ProjectReaderTests-302102808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.968d9bd7-ff9d-43ef-bdb3-a373968b26d4" returned: 0 in 0.805s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:24 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-4daa5805-dfb1-442f-a451-95510fe8c99f tempest-ProjectReaderTests-302102808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:17:24 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbb84ce-9618-445e-92f4-0c16d2122183]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4daa5805-dfb1-442f-a451-95510fe8c99f tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:24 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8 Jul 07 22:17:24 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:24 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3 1073741824" returned: 0 in 0.838s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:24 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3 Jul 07 22:17:24 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:25 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4daa5805-dfb1-442f-a451-95510fe8c99f tempest-ProjectReaderTests-302102808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8" returned: 0 in 0.794s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4daa5805-dfb1-442f-a451-95510fe8c99f tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.968d9bd7-ff9d-43ef-bdb3-a373968b26d4 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:25 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3" returned: 0 in 0.651s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:17:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:25 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.968d9bd7-ff9d-43ef-bdb3-a373968b26d4 Jul 07 22:17:25 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faec25b1-8550-46b6-9fb4-fa9ce0410988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a7ce1e-eeee-4139-9bce-5880cdf0789b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:25 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Volume volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3 (7e6aac97-46d5-4609-9c60-2fea8a9b53a3): created successfully Jul 07 22:17:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a7ce1e-eeee-4139-9bce-5880cdf0789b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:25 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Flow 'volume_create_manager' (6290dfcf-df49-4247-87f8-aff5d37b5049) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:17:25 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6410d111-dfb8-4805-ba23-bf02dd20bd31 tempest-ProjectMemberTests-811768835 None] Created volume successfully. Jul 07 22:17:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d06b2622-e5c2-4250-aa1b-b6a452f55ba1 tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d06b2622-e5c2-4250-aa1b-b6a452f55ba1 tempest-ProjectMemberTests-811768835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:25 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-d06b2622-e5c2-4250-aa1b-b6a452f55ba1 tempest-ProjectMemberTests-811768835 None] Creating offline snapshot bc58793d-88b5-4362-af63-22aabde9b03c of volume 7e6aac97-46d5-4609-9c60-2fea8a9b53a3 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:17:25 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba06dcba-d087-4cb7-a56e-c4554c4dea3a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d06b2622-e5c2-4250-aa1b-b6a452f55ba1 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:25 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3 Jul 07 22:17:25 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:25 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4daa5805-dfb1-442f-a451-95510fe8c99f tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.968d9bd7-ff9d-43ef-bdb3-a373968b26d4" returned: 0 in 0.769s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4daa5805-dfb1-442f-a451-95510fe8c99f tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.968d9bd7-ff9d-43ef-bdb3-a373968b26d4 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:25 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.968d9bd7-ff9d-43ef-bdb3-a373968b26d4 Jul 07 22:17:25 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:26 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d06b2622-e5c2-4250-aa1b-b6a452f55ba1 tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3" returned: 0 in 0.785s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d06b2622-e5c2-4250-aa1b-b6a452f55ba1 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.bc58793d-88b5-4362-af63-22aabde9b03c 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:26 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4daa5805-dfb1-442f-a451-95510fe8c99f tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8.968d9bd7-ff9d-43ef-bdb3-a373968b26d4" returned: 0 in 0.674s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:26 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.bc58793d-88b5-4362-af63-22aabde9b03c 1G Jul 07 22:17:26 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:26 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4daa5805-dfb1-442f-a451-95510fe8c99f tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-968d9bd7-ff9d-43ef-bdb3-a373968b26d4" released by "_delete_snapshot" :: held 3.144s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:26 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4daa5805-dfb1-442f-a451-95510fe8c99f tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-9fa9a18d-c07b-4190-8374-d69fbb0e46b8" released by "delete_snapshot" :: held 3.172s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:26 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-4daa5805-dfb1-442f-a451-95510fe8c99f tempest-ProjectReaderTests-302102808 None] Created reservations ['3698719c-bcd4-4142-954a-481abaf70ad7', 'd9f82277-90b9-44f9-a9e9-f89c9b211a18', '4087aec0-e2f5-49f4-a475-a357e7afaa72', '73f65021-4e12-4dc2-9067-2d9eda1ceb08'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:17:26 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-4daa5805-dfb1-442f-a451-95510fe8c99f tempest-ProjectReaderTests-302102808 None] Delete snapshot completed successfully. Jul 07 22:17:26 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-4daa5805-dfb1-442f-a451-95510fe8c99f tempest-ProjectReaderTests-302102808 None] Lock "cinder-968d9bd7-ff9d-43ef-bdb3-a373968b26d4-delete_snapshot" released by "delete_snapshot" :: held 3.317s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:27 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d06b2622-e5c2-4250-aa1b-b6a452f55ba1 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.bc58793d-88b5-4362-af63-22aabde9b03c 1G" returned: 0 in 0.813s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d06b2622-e5c2-4250-aa1b-b6a452f55ba1 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.bc58793d-88b5-4362-af63-22aabde9b03c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:27 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.bc58793d-88b5-4362-af63-22aabde9b03c Jul 07 22:17:27 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8f648dcb-20db-4c4a-bf19-06b16a80f66d tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-9fa9a18d-c07b-4190-8374-d69fbb0e46b8-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8f648dcb-20db-4c4a-bf19-06b16a80f66d tempest-ProjectReaderTests-302102808 None] Lock "cinder-9fa9a18d-c07b-4190-8374-d69fbb0e46b8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8f648dcb-20db-4c4a-bf19-06b16a80f66d tempest-ProjectReaderTests-302102808 None] Acquiring lock "cinder-quobyte-9fa9a18d-c07b-4190-8374-d69fbb0e46b8" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:27 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8f648dcb-20db-4c4a-bf19-06b16a80f66d tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-9fa9a18d-c07b-4190-8374-d69fbb0e46b8" acquired by "delete_volume" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:27 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebb05ef-b5cd-4193-a5b3-7318469e2707]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8f648dcb-20db-4c4a-bf19-06b16a80f66d tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:27 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8 Jul 07 22:17:27 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:28 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d06b2622-e5c2-4250-aa1b-b6a452f55ba1 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.bc58793d-88b5-4362-af63-22aabde9b03c" returned: 0 in 0.680s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:28 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-d06b2622-e5c2-4250-aa1b-b6a452f55ba1 tempest-ProjectMemberTests-811768835 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.bc58793d-88b5-4362-af63-22aabde9b03c is being set with open permissions: ugo+rw Jul 07 22:17:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d06b2622-e5c2-4250-aa1b-b6a452f55ba1 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.bc58793d-88b5-4362-af63-22aabde9b03c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:28 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.bc58793d-88b5-4362-af63-22aabde9b03c Jul 07 22:17:28 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:28 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8f648dcb-20db-4c4a-bf19-06b16a80f66d tempest-ProjectReaderTests-302102808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8" returned: 0 in 0.764s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8f648dcb-20db-4c4a-bf19-06b16a80f66d tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:28 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8 Jul 07 22:17:28 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:28 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d06b2622-e5c2-4250-aa1b-b6a452f55ba1 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.bc58793d-88b5-4362-af63-22aabde9b03c" returned: 0 in 0.646s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d06b2622-e5c2-4250-aa1b-b6a452f55ba1 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:28 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.info Jul 07 22:17:28 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:29 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8f648dcb-20db-4c4a-bf19-06b16a80f66d tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-9fa9a18d-c07b-4190-8374-d69fbb0e46b8" returned: 0 in 0.646s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8f648dcb-20db-4c4a-bf19-06b16a80f66d tempest-ProjectReaderTests-302102808 None] Lock "cinder-quobyte-9fa9a18d-c07b-4190-8374-d69fbb0e46b8" released by "delete_volume" :: held 1.490s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:29 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-8f648dcb-20db-4c4a-bf19-06b16a80f66d tempest-ProjectReaderTests-302102808 None] Created reservations ['50dc1541-d1b1-41f5-9664-b77118fdc5a0', '8db28951-238d-426d-b469-236901e6d532', '81ecf9e0-0cbb-44f1-949e-e373cdab1f6b', '9c386fb6-95b4-4695-8449-979c11ad2a69'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:17:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8f648dcb-20db-4c4a-bf19-06b16a80f66d tempest-ProjectReaderTests-302102808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8f648dcb-20db-4c4a-bf19-06b16a80f66d tempest-ProjectReaderTests-302102808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:29 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8f648dcb-20db-4c4a-bf19-06b16a80f66d tempest-ProjectReaderTests-302102808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:17:29 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8f648dcb-20db-4c4a-bf19-06b16a80f66d tempest-ProjectReaderTests-302102808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:17:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8f648dcb-20db-4c4a-bf19-06b16a80f66d tempest-ProjectReaderTests-302102808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8f648dcb-20db-4c4a-bf19-06b16a80f66d tempest-ProjectReaderTests-302102808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:29 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:17:29 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:29 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d06b2622-e5c2-4250-aa1b-b6a452f55ba1 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.info" returned: 0 in 0.682s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:29 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-d06b2622-e5c2-4250-aa1b-b6a452f55ba1 tempest-ProjectMemberTests-811768835 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.info is being set with open permissions: ugo+rw Jul 07 22:17:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d06b2622-e5c2-4250-aa1b-b6a452f55ba1 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:29 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.info Jul 07 22:17:29 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:30 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8f648dcb-20db-4c4a-bf19-06b16a80f66d tempest-ProjectReaderTests-302102808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.666s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:30 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-8f648dcb-20db-4c4a-bf19-06b16a80f66d tempest-ProjectReaderTests-302102808 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:17:30 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-8f648dcb-20db-4c4a-bf19-06b16a80f66d tempest-ProjectReaderTests-302102808 None] Deleted volume successfully. Jul 07 22:17:30 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d06b2622-e5c2-4250-aa1b-b6a452f55ba1 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.info" returned: 0 in 0.658s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-d06b2622-e5c2-4250-aa1b-b6a452f55ba1 tempest-ProjectMemberTests-811768835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.351s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:30 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8f648dcb-20db-4c4a-bf19-06b16a80f66d tempest-ProjectReaderTests-302102808 None] Lock "cinder-9fa9a18d-c07b-4190-8374-d69fbb0e46b8-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:30 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d06b2622-e5c2-4250-aa1b-b6a452f55ba1 tempest-ProjectMemberTests-811768835 None] Create snapshot completed successfully Jul 07 22:17:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-558e3ec4-40ae-4295-ba03-0e4c0ec5e27f tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-bc58793d-88b5-4362-af63-22aabde9b03c-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-558e3ec4-40ae-4295-ba03-0e4c0ec5e27f tempest-ProjectMemberTests-811768835 None] Lock "cinder-bc58793d-88b5-4362-af63-22aabde9b03c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-558e3ec4-40ae-4295-ba03-0e4c0ec5e27f tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-7e6aac97-46d5-4609-9c60-2fea8a9b53a3" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-558e3ec4-40ae-4295-ba03-0e4c0ec5e27f tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-7e6aac97-46d5-4609-9c60-2fea8a9b53a3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-558e3ec4-40ae-4295-ba03-0e4c0ec5e27f tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-bc58793d-88b5-4362-af63-22aabde9b03c" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-558e3ec4-40ae-4295-ba03-0e4c0ec5e27f tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-bc58793d-88b5-4362-af63-22aabde9b03c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-558e3ec4-40ae-4295-ba03-0e4c0ec5e27f tempest-ProjectMemberTests-811768835 None] Deleting offline snapshot bc58793d-88b5-4362-af63-22aabde9b03c of volume 7e6aac97-46d5-4609-9c60-2fea8a9b53a3 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:17:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-558e3ec4-40ae-4295-ba03-0e4c0ec5e27f tempest-ProjectMemberTests-811768835 None] snapshot_file for this snap is: volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.bc58793d-88b5-4362-af63-22aabde9b03c {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:17:31 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[09820821-a02d-4ea2-8eb8-35e74a227243]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-558e3ec4-40ae-4295-ba03-0e4c0ec5e27f tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.bc58793d-88b5-4362-af63-22aabde9b03c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:31 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.bc58793d-88b5-4362-af63-22aabde9b03c Jul 07 22:17:31 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:31 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-558e3ec4-40ae-4295-ba03-0e4c0ec5e27f tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.bc58793d-88b5-4362-af63-22aabde9b03c" returned: 0 in 0.778s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-558e3ec4-40ae-4295-ba03-0e4c0ec5e27f tempest-ProjectMemberTests-811768835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:17:31 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc92ab4f-e0e9-4e33-9015-840b3f52274e]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-558e3ec4-40ae-4295-ba03-0e4c0ec5e27f tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:32 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3 Jul 07 22:17:32 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:32 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-558e3ec4-40ae-4295-ba03-0e4c0ec5e27f tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3" returned: 0 in 0.770s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-558e3ec4-40ae-4295-ba03-0e4c0ec5e27f tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.bc58793d-88b5-4362-af63-22aabde9b03c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:32 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.bc58793d-88b5-4362-af63-22aabde9b03c Jul 07 22:17:32 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:33 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-558e3ec4-40ae-4295-ba03-0e4c0ec5e27f tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.bc58793d-88b5-4362-af63-22aabde9b03c" returned: 0 in 0.820s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-558e3ec4-40ae-4295-ba03-0e4c0ec5e27f tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.bc58793d-88b5-4362-af63-22aabde9b03c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:33 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.bc58793d-88b5-4362-af63-22aabde9b03c Jul 07 22:17:33 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:34 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-558e3ec4-40ae-4295-ba03-0e4c0ec5e27f tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3.bc58793d-88b5-4362-af63-22aabde9b03c" returned: 0 in 0.703s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-558e3ec4-40ae-4295-ba03-0e4c0ec5e27f tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-bc58793d-88b5-4362-af63-22aabde9b03c" released by "_delete_snapshot" :: held 3.173s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-558e3ec4-40ae-4295-ba03-0e4c0ec5e27f tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-7e6aac97-46d5-4609-9c60-2fea8a9b53a3" released by "delete_snapshot" :: held 3.198s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:34 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-558e3ec4-40ae-4295-ba03-0e4c0ec5e27f tempest-ProjectMemberTests-811768835 None] Created reservations ['4c4eebd9-2247-4fba-a3b2-406dceab4b76', '9d8f57c3-03e0-4fec-82d7-6f19d98c4f92', 'f5576c9d-0f6a-43f2-bd0c-98fb0b5099ef', '1def2a83-0bb6-4817-ae13-3baf6f82aceb'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:17:34 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-558e3ec4-40ae-4295-ba03-0e4c0ec5e27f tempest-ProjectMemberTests-811768835 None] Delete snapshot completed successfully. Jul 07 22:17:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-558e3ec4-40ae-4295-ba03-0e4c0ec5e27f tempest-ProjectMemberTests-811768835 None] Lock "cinder-bc58793d-88b5-4362-af63-22aabde9b03c-delete_snapshot" released by "delete_snapshot" :: held 3.358s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1acfd93d-11f6-40ba-bc15-bda4bb36aebe tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-7e6aac97-46d5-4609-9c60-2fea8a9b53a3-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1acfd93d-11f6-40ba-bc15-bda4bb36aebe tempest-ProjectMemberTests-811768835 None] Lock "cinder-7e6aac97-46d5-4609-9c60-2fea8a9b53a3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1acfd93d-11f6-40ba-bc15-bda4bb36aebe tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-7e6aac97-46d5-4609-9c60-2fea8a9b53a3" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1acfd93d-11f6-40ba-bc15-bda4bb36aebe tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-7e6aac97-46d5-4609-9c60-2fea8a9b53a3" acquired by "delete_volume" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:35 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffdb72e-9ba3-437a-bf1a-1d0de5f1b875]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1acfd93d-11f6-40ba-bc15-bda4bb36aebe tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:35 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3 Jul 07 22:17:35 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:17:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:17:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:17:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:35 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:17:35 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:36 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1acfd93d-11f6-40ba-bc15-bda4bb36aebe tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3" returned: 0 in 0.805s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1acfd93d-11f6-40ba-bc15-bda4bb36aebe tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:36 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3 Jul 07 22:17:36 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:36 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.698s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:17:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:17:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 28 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 22:17:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 22:17:36 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1acfd93d-11f6-40ba-bc15-bda4bb36aebe tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-7e6aac97-46d5-4609-9c60-2fea8a9b53a3" returned: 0 in 0.649s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:36 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1acfd93d-11f6-40ba-bc15-bda4bb36aebe tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-7e6aac97-46d5-4609-9c60-2fea8a9b53a3" released by "delete_volume" :: held 1.526s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:36 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-1acfd93d-11f6-40ba-bc15-bda4bb36aebe tempest-ProjectMemberTests-811768835 None] Created reservations ['d7c75e8b-3ee4-4cbf-882b-722038f6e678', '2857d617-2925-4e68-9946-556c1751fe89', 'c8fd7ca1-83db-4a21-aab7-96bcd44cbcd9', '16bf0954-1f87-4dfd-a1a8-23742b925eb1'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:17:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1acfd93d-11f6-40ba-bc15-bda4bb36aebe tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1acfd93d-11f6-40ba-bc15-bda4bb36aebe tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:36 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1acfd93d-11f6-40ba-bc15-bda4bb36aebe tempest-ProjectMemberTests-811768835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:17:36 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1acfd93d-11f6-40ba-bc15-bda4bb36aebe tempest-ProjectMemberTests-811768835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:17:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1acfd93d-11f6-40ba-bc15-bda4bb36aebe tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1acfd93d-11f6-40ba-bc15-bda4bb36aebe tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:37 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:17:37 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:37 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1acfd93d-11f6-40ba-bc15-bda4bb36aebe tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.648s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:37 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-1acfd93d-11f6-40ba-bc15-bda4bb36aebe tempest-ProjectMemberTests-811768835 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:17:37 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-1acfd93d-11f6-40ba-bc15-bda4bb36aebe tempest-ProjectMemberTests-811768835 None] Deleted volume successfully. Jul 07 22:17:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1acfd93d-11f6-40ba-bc15-bda4bb36aebe tempest-ProjectMemberTests-811768835 None] Lock "cinder-7e6aac97-46d5-4609-9c60-2fea8a9b53a3-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:37 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:17:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Flow 'volume_create_manager' (5b1f0d19-4367-4aa4-9c66-78eb974d7cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:17:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367bdc7e-a5ce-4849-bdb9-7356dee5ec43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:37 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367bdc7e-a5ce-4849-bdb9-7356dee5ec43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-97350258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456553e8-a45e-45d8-914d-1428c9fdf57e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72ec43c2b314ec2b44c0cd84238b6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:17:38Z,use_quota=True,user_id='cc4275e59c51481badff6b228bedd03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65bc40d-610a-4834-a5a7-88ad599089a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65bc40d-610a-4834-a5a7-88ad599089a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99c61d2-efa1-4718-83b3-79b7c37b0324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99c61d2-efa1-4718-83b3-79b7c37b0324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '456553e8-a45e-45d8-914d-1428c9fdf57e', 'volume_name': 'volume-456553e8-a45e-45d8-914d-1428c9fdf57e', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d8eb22-2884-4601-92a0-d30d76546376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d8eb22-2884-4601-92a0-d30d76546376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:38 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06dafed8-98c5-4f87-a2a2-223dec27ca05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:38 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Volume 456553e8-a45e-45d8-914d-1428c9fdf57e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-456553e8-a45e-45d8-914d-1428c9fdf57e', 'volume_size': 1} Jul 07 22:17:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:38 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-97350258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456553e8-a45e-45d8-914d-1428c9fdf57e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72ec43c2b314ec2b44c0cd84238b6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:17:38Z,use_quota=True,user_id='cc4275e59c51481badff6b228bedd03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:17:38 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Creating volume 456553e8-a45e-45d8-914d-1428c9fdf57e {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:17:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:38 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:17:38 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:17:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:38 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:17:38 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:17:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:38 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e 1073741824 Jul 07 22:17:38 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:38 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e 1073741824" returned: 0 in 0.874s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:38 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e Jul 07 22:17:38 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:39 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e" returned: 0 in 0.651s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:39 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:17:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06dafed8-98c5-4f87-a2a2-223dec27ca05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-456553e8-a45e-45d8-914d-1428c9fdf57e', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4ef6090-23bc-4bc1-880d-d26b9ae27a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:39 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Volume volume-456553e8-a45e-45d8-914d-1428c9fdf57e (456553e8-a45e-45d8-914d-1428c9fdf57e): created successfully Jul 07 22:17:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4ef6090-23bc-4bc1-880d-d26b9ae27a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:39 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Flow 'volume_create_manager' (5b1f0d19-4367-4aa4-9c66-78eb974d7cd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:17:39 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-afa81c0c-e5d1-4249-9051-8b64bb446dc1 tempest-ProjectMemberTests-811768835 None] Created volume successfully. Jul 07 22:17:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9dcfb1fb-f0de-422f-8696-73b7682d540c tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9dcfb1fb-f0de-422f-8696-73b7682d540c tempest-ProjectMemberTests-811768835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:40 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-9dcfb1fb-f0de-422f-8696-73b7682d540c tempest-ProjectMemberTests-811768835 None] Creating offline snapshot de852ea8-94ff-4e60-a560-8a612ac91c10 of volume 456553e8-a45e-45d8-914d-1428c9fdf57e {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:17:40 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff19d4a5-9e6f-4e27-9319-52a3324faad4]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9dcfb1fb-f0de-422f-8696-73b7682d540c tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:40 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e Jul 07 22:17:40 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:41 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9dcfb1fb-f0de-422f-8696-73b7682d540c tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e" returned: 0 in 0.755s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9dcfb1fb-f0de-422f-8696-73b7682d540c tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.de852ea8-94ff-4e60-a560-8a612ac91c10 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:41 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.de852ea8-94ff-4e60-a560-8a612ac91c10 1G Jul 07 22:17:41 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:41 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9dcfb1fb-f0de-422f-8696-73b7682d540c tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.de852ea8-94ff-4e60-a560-8a612ac91c10 1G" returned: 0 in 0.798s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9dcfb1fb-f0de-422f-8696-73b7682d540c tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-456553e8-a45e-45d8-914d-1428c9fdf57e -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.de852ea8-94ff-4e60-a560-8a612ac91c10 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:41 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-456553e8-a45e-45d8-914d-1428c9fdf57e -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.de852ea8-94ff-4e60-a560-8a612ac91c10 Jul 07 22:17:41 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:42 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9dcfb1fb-f0de-422f-8696-73b7682d540c tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-456553e8-a45e-45d8-914d-1428c9fdf57e -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.de852ea8-94ff-4e60-a560-8a612ac91c10" returned: 0 in 0.673s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:42 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-9dcfb1fb-f0de-422f-8696-73b7682d540c tempest-ProjectMemberTests-811768835 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.de852ea8-94ff-4e60-a560-8a612ac91c10 is being set with open permissions: ugo+rw Jul 07 22:17:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9dcfb1fb-f0de-422f-8696-73b7682d540c tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.de852ea8-94ff-4e60-a560-8a612ac91c10 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:42 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.de852ea8-94ff-4e60-a560-8a612ac91c10 Jul 07 22:17:42 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:43 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9dcfb1fb-f0de-422f-8696-73b7682d540c tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.de852ea8-94ff-4e60-a560-8a612ac91c10" returned: 0 in 0.613s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9dcfb1fb-f0de-422f-8696-73b7682d540c tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:43 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.info Jul 07 22:17:43 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:43 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9dcfb1fb-f0de-422f-8696-73b7682d540c tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.info" returned: 0 in 0.689s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:43 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-9dcfb1fb-f0de-422f-8696-73b7682d540c tempest-ProjectMemberTests-811768835 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.info is being set with open permissions: ugo+rw Jul 07 22:17:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9dcfb1fb-f0de-422f-8696-73b7682d540c tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:43 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.info Jul 07 22:17:43 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:44 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-9dcfb1fb-f0de-422f-8696-73b7682d540c tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.info" returned: 0 in 0.670s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-9dcfb1fb-f0de-422f-8696-73b7682d540c tempest-ProjectMemberTests-811768835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.284s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:44 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-9dcfb1fb-f0de-422f-8696-73b7682d540c tempest-ProjectMemberTests-811768835 None] Create snapshot completed successfully Jul 07 22:17:45 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6ed334d4-0dda-4ff8-9908-6d42a22dac92 tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-de852ea8-94ff-4e60-a560-8a612ac91c10-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:45 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6ed334d4-0dda-4ff8-9908-6d42a22dac92 tempest-ProjectMemberTests-811768835 None] Lock "cinder-de852ea8-94ff-4e60-a560-8a612ac91c10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:45 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6ed334d4-0dda-4ff8-9908-6d42a22dac92 tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-456553e8-a45e-45d8-914d-1428c9fdf57e" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:45 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6ed334d4-0dda-4ff8-9908-6d42a22dac92 tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-456553e8-a45e-45d8-914d-1428c9fdf57e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:45 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6ed334d4-0dda-4ff8-9908-6d42a22dac92 tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-de852ea8-94ff-4e60-a560-8a612ac91c10" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:45 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6ed334d4-0dda-4ff8-9908-6d42a22dac92 tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-de852ea8-94ff-4e60-a560-8a612ac91c10" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-6ed334d4-0dda-4ff8-9908-6d42a22dac92 tempest-ProjectMemberTests-811768835 None] Deleting offline snapshot de852ea8-94ff-4e60-a560-8a612ac91c10 of volume 456553e8-a45e-45d8-914d-1428c9fdf57e {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:17:45 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-6ed334d4-0dda-4ff8-9908-6d42a22dac92 tempest-ProjectMemberTests-811768835 None] snapshot_file for this snap is: volume-456553e8-a45e-45d8-914d-1428c9fdf57e.de852ea8-94ff-4e60-a560-8a612ac91c10 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:17:45 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[956b1395-b9df-4834-a3b8-87b97df2890d]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6ed334d4-0dda-4ff8-9908-6d42a22dac92 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.de852ea8-94ff-4e60-a560-8a612ac91c10 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:45 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.de852ea8-94ff-4e60-a560-8a612ac91c10 Jul 07 22:17:45 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:46 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6ed334d4-0dda-4ff8-9908-6d42a22dac92 tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.de852ea8-94ff-4e60-a560-8a612ac91c10" returned: 0 in 0.778s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:46 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-6ed334d4-0dda-4ff8-9908-6d42a22dac92 tempest-ProjectMemberTests-811768835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-456553e8-a45e-45d8-914d-1428c9fdf57e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:17:46 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf1359b-7deb-4a1e-8ae9-ca432d47c1b6]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6ed334d4-0dda-4ff8-9908-6d42a22dac92 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:46 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e Jul 07 22:17:46 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:47 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6ed334d4-0dda-4ff8-9908-6d42a22dac92 tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e" returned: 0 in 0.769s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6ed334d4-0dda-4ff8-9908-6d42a22dac92 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.de852ea8-94ff-4e60-a560-8a612ac91c10 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:47 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.de852ea8-94ff-4e60-a560-8a612ac91c10 Jul 07 22:17:47 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:47 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6ed334d4-0dda-4ff8-9908-6d42a22dac92 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.de852ea8-94ff-4e60-a560-8a612ac91c10" returned: 0 in 0.755s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6ed334d4-0dda-4ff8-9908-6d42a22dac92 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.de852ea8-94ff-4e60-a560-8a612ac91c10 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:47 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.de852ea8-94ff-4e60-a560-8a612ac91c10 Jul 07 22:17:47 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:48 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:48 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6ed334d4-0dda-4ff8-9908-6d42a22dac92 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e.de852ea8-94ff-4e60-a560-8a612ac91c10" returned: 0 in 0.628s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:48 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6ed334d4-0dda-4ff8-9908-6d42a22dac92 tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-de852ea8-94ff-4e60-a560-8a612ac91c10" released by "_delete_snapshot" :: held 3.024s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:48 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6ed334d4-0dda-4ff8-9908-6d42a22dac92 tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-456553e8-a45e-45d8-914d-1428c9fdf57e" released by "delete_snapshot" :: held 3.048s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:48 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-6ed334d4-0dda-4ff8-9908-6d42a22dac92 tempest-ProjectMemberTests-811768835 None] Created reservations ['eb98f7fc-0e61-4ed4-bf54-bba01b3166fc', '9273f417-e8fa-46c2-aefe-27f9d64a3144', '3d6f5fdb-a022-4f43-b810-9c5dc3b0d262', '283d2a7b-88aa-4c4c-9ee3-34322a08e59d'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:17:48 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6ed334d4-0dda-4ff8-9908-6d42a22dac92 tempest-ProjectMemberTests-811768835 None] Delete snapshot completed successfully. Jul 07 22:17:48 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6ed334d4-0dda-4ff8-9908-6d42a22dac92 tempest-ProjectMemberTests-811768835 None] Lock "cinder-de852ea8-94ff-4e60-a560-8a612ac91c10-delete_snapshot" released by "delete_snapshot" :: held 3.200s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:49 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6e9fb9a1-9d56-459c-a87c-b2a6b4475340 tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-456553e8-a45e-45d8-914d-1428c9fdf57e-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:49 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6e9fb9a1-9d56-459c-a87c-b2a6b4475340 tempest-ProjectMemberTests-811768835 None] Lock "cinder-456553e8-a45e-45d8-914d-1428c9fdf57e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:49 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6e9fb9a1-9d56-459c-a87c-b2a6b4475340 tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-456553e8-a45e-45d8-914d-1428c9fdf57e" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:49 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6e9fb9a1-9d56-459c-a87c-b2a6b4475340 tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-456553e8-a45e-45d8-914d-1428c9fdf57e" acquired by "delete_volume" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:49 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b5a6d4-902a-4f80-a158-1ddb516e4ae8]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:49 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6e9fb9a1-9d56-459c-a87c-b2a6b4475340 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:49 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e Jul 07 22:17:49 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:50 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6e9fb9a1-9d56-459c-a87c-b2a6b4475340 tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e" returned: 0 in 0.747s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:50 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6e9fb9a1-9d56-459c-a87c-b2a6b4475340 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:50 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e Jul 07 22:17:50 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:51 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6e9fb9a1-9d56-459c-a87c-b2a6b4475340 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-456553e8-a45e-45d8-914d-1428c9fdf57e" returned: 0 in 0.639s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:51 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6e9fb9a1-9d56-459c-a87c-b2a6b4475340 tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-456553e8-a45e-45d8-914d-1428c9fdf57e" released by "delete_volume" :: held 1.445s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:51 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-6e9fb9a1-9d56-459c-a87c-b2a6b4475340 tempest-ProjectMemberTests-811768835 None] Created reservations ['faeaa778-6996-4095-b82c-925941300a10', '324d103f-a150-4ef5-83a1-a9eaaaecbeaa', 'eb653a98-bd9e-4b31-94ee-99a353034da6', '9778d751-da74-4051-a045-62f0caa2b084'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:17:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6e9fb9a1-9d56-459c-a87c-b2a6b4475340 tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6e9fb9a1-9d56-459c-a87c-b2a6b4475340 tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6e9fb9a1-9d56-459c-a87c-b2a6b4475340 tempest-ProjectMemberTests-811768835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:17:51 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-6e9fb9a1-9d56-459c-a87c-b2a6b4475340 tempest-ProjectMemberTests-811768835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:17:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-6e9fb9a1-9d56-459c-a87c-b2a6b4475340 tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:51 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6e9fb9a1-9d56-459c-a87c-b2a6b4475340 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:51 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:17:51 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:52 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-6e9fb9a1-9d56-459c-a87c-b2a6b4475340 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.678s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-6e9fb9a1-9d56-459c-a87c-b2a6b4475340 tempest-ProjectMemberTests-811768835 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:17:52 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-6e9fb9a1-9d56-459c-a87c-b2a6b4475340 tempest-ProjectMemberTests-811768835 None] Deleted volume successfully. Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-6e9fb9a1-9d56-459c-a87c-b2a6b4475340 tempest-ProjectMemberTests-811768835 None] Lock "cinder-456553e8-a45e-45d8-914d-1428c9fdf57e-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Flow 'volume_create_manager' (6847322b-6c81-4d7b-929c-97aa8a7052c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5cc9483-a2d2-42b7-a8ec-2f1a5cd0fcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5cc9483-a2d2-42b7-a8ec-2f1a5cd0fcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1763202644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed61eaf7-ed39-45f0-bad5-1ac4c342e086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72ec43c2b314ec2b44c0cd84238b6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:17:52Z,use_quota=True,user_id='cc4275e59c51481badff6b228bedd03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (934e37c7-75f8-40e6-b4a6-bd89837969af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (934e37c7-75f8-40e6-b4a6-bd89837969af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e48c90d6-661b-421c-ad0f-7e937773a10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e48c90d6-661b-421c-ad0f-7e937773a10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed61eaf7-ed39-45f0-bad5-1ac4c342e086', 'volume_name': 'volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7f8c62-cd5d-4549-92b9-d7fba2d62d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7f8c62-cd5d-4549-92b9-d7fba2d62d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50a61ae-bd29-48f4-a743-76a9e2720a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:52 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Volume ed61eaf7-ed39-45f0-bad5-1ac4c342e086: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086', 'volume_size': 1} Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1763202644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed61eaf7-ed39-45f0-bad5-1ac4c342e086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72ec43c2b314ec2b44c0cd84238b6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:17:52Z,use_quota=True,user_id='cc4275e59c51481badff6b228bedd03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Creating volume ed61eaf7-ed39-45f0-bad5-1ac4c342e086 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:17:52 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:17:52 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:52 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086 1073741824 Jul 07 22:17:52 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:53 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086 1073741824" returned: 0 in 0.897s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:53 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:53 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086 Jul 07 22:17:53 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:54 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086" returned: 0 in 0.655s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:54 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:17:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50a61ae-bd29-48f4-a743-76a9e2720a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53a62a4-d620-4892-8423-01602dc17925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:17:54 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Volume volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086 (ed61eaf7-ed39-45f0-bad5-1ac4c342e086): created successfully Jul 07 22:17:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53a62a4-d620-4892-8423-01602dc17925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:17:54 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Flow 'volume_create_manager' (6847322b-6c81-4d7b-929c-97aa8a7052c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:17:54 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-e9dc48a3-317b-412e-a6d0-00fdb9976016 tempest-ProjectMemberTests-811768835 None] Created volume successfully. Jul 07 22:17:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0dd703e8-601d-4346-b1be-8b5c103381ef tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:17:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0dd703e8-601d-4346-b1be-8b5c103381ef tempest-ProjectMemberTests-811768835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:17:54 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-0dd703e8-601d-4346-b1be-8b5c103381ef tempest-ProjectMemberTests-811768835 None] Creating offline snapshot 4299ae1f-37df-4387-88b7-177a82813852 of volume ed61eaf7-ed39-45f0-bad5-1ac4c342e086 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:17:54 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[81504ef2-23bd-402c-8146-8db7538ad341]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:54 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0dd703e8-601d-4346-b1be-8b5c103381ef tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:54 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086 Jul 07 22:17:54 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:55 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0dd703e8-601d-4346-b1be-8b5c103381ef tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086" returned: 0 in 0.797s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:55 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0dd703e8-601d-4346-b1be-8b5c103381ef tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.4299ae1f-37df-4387-88b7-177a82813852 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:55 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.4299ae1f-37df-4387-88b7-177a82813852 1G Jul 07 22:17:55 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:56 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0dd703e8-601d-4346-b1be-8b5c103381ef tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.4299ae1f-37df-4387-88b7-177a82813852 1G" returned: 0 in 0.830s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:56 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0dd703e8-601d-4346-b1be-8b5c103381ef tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.4299ae1f-37df-4387-88b7-177a82813852 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:56 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.4299ae1f-37df-4387-88b7-177a82813852 Jul 07 22:17:56 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:57 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0dd703e8-601d-4346-b1be-8b5c103381ef tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.4299ae1f-37df-4387-88b7-177a82813852" returned: 0 in 0.710s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:57 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-0dd703e8-601d-4346-b1be-8b5c103381ef tempest-ProjectMemberTests-811768835 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.4299ae1f-37df-4387-88b7-177a82813852 is being set with open permissions: ugo+rw Jul 07 22:17:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0dd703e8-601d-4346-b1be-8b5c103381ef tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.4299ae1f-37df-4387-88b7-177a82813852 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:57 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.4299ae1f-37df-4387-88b7-177a82813852 Jul 07 22:17:57 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:57 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0dd703e8-601d-4346-b1be-8b5c103381ef tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.4299ae1f-37df-4387-88b7-177a82813852" returned: 0 in 0.672s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:57 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0dd703e8-601d-4346-b1be-8b5c103381ef tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:57 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.info Jul 07 22:17:57 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:58 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0dd703e8-601d-4346-b1be-8b5c103381ef tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.info" returned: 0 in 0.672s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:58 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-0dd703e8-601d-4346-b1be-8b5c103381ef tempest-ProjectMemberTests-811768835 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.info is being set with open permissions: ugo+rw Jul 07 22:17:58 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0dd703e8-601d-4346-b1be-8b5c103381ef tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:17:58 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.info Jul 07 22:17:58 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:17:59 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 07 22:17:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0dd703e8-601d-4346-b1be-8b5c103381ef tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.info" returned: 0 in 0.650s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:17:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-0dd703e8-601d-4346-b1be-8b5c103381ef tempest-ProjectMemberTests-811768835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.422s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:17:59 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=93,cinder:INSERT=30,cinder:UPDATE=108,cinder:DELETE=8 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:17:59 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:INSERT=35,cinder:UPDATE=125,cinder:SELECT=85,cinder:DELETE=11 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:17:59 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-0dd703e8-601d-4346-b1be-8b5c103381ef tempest-ProjectMemberTests-811768835 None] Create snapshot completed successfully Jul 07 22:17:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0addb98a-bb9c-4ff0-85bd-699fcdd079f3 tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-4299ae1f-37df-4387-88b7-177a82813852-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0addb98a-bb9c-4ff0-85bd-699fcdd079f3 tempest-ProjectMemberTests-811768835 None] Lock "cinder-4299ae1f-37df-4387-88b7-177a82813852-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0addb98a-bb9c-4ff0-85bd-699fcdd079f3 tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-ed61eaf7-ed39-45f0-bad5-1ac4c342e086" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0addb98a-bb9c-4ff0-85bd-699fcdd079f3 tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-ed61eaf7-ed39-45f0-bad5-1ac4c342e086" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0addb98a-bb9c-4ff0-85bd-699fcdd079f3 tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-4299ae1f-37df-4387-88b7-177a82813852" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:17:59 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0addb98a-bb9c-4ff0-85bd-699fcdd079f3 tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-4299ae1f-37df-4387-88b7-177a82813852" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:17:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-0addb98a-bb9c-4ff0-85bd-699fcdd079f3 tempest-ProjectMemberTests-811768835 None] Deleting offline snapshot 4299ae1f-37df-4387-88b7-177a82813852 of volume ed61eaf7-ed39-45f0-bad5-1ac4c342e086 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:17:59 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-0addb98a-bb9c-4ff0-85bd-699fcdd079f3 tempest-ProjectMemberTests-811768835 None] snapshot_file for this snap is: volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.4299ae1f-37df-4387-88b7-177a82813852 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:17:59 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b6a0f6-0895-4920-9a41-8e5f6d26193f]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:17:59 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0addb98a-bb9c-4ff0-85bd-699fcdd079f3 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.4299ae1f-37df-4387-88b7-177a82813852 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:00 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.4299ae1f-37df-4387-88b7-177a82813852 Jul 07 22:18:00 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:00 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0addb98a-bb9c-4ff0-85bd-699fcdd079f3 tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.4299ae1f-37df-4387-88b7-177a82813852" returned: 0 in 0.766s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:00 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-0addb98a-bb9c-4ff0-85bd-699fcdd079f3 tempest-ProjectMemberTests-811768835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:18:00 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4f554a-7fdf-4d10-afe8-397811b9732d]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:18:00 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0addb98a-bb9c-4ff0-85bd-699fcdd079f3 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:00 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086 Jul 07 22:18:00 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:01 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0addb98a-bb9c-4ff0-85bd-699fcdd079f3 tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086" returned: 0 in 0.761s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:01 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0addb98a-bb9c-4ff0-85bd-699fcdd079f3 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.4299ae1f-37df-4387-88b7-177a82813852 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:01 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.4299ae1f-37df-4387-88b7-177a82813852 Jul 07 22:18:01 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:02 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0addb98a-bb9c-4ff0-85bd-699fcdd079f3 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.4299ae1f-37df-4387-88b7-177a82813852" returned: 0 in 0.706s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0addb98a-bb9c-4ff0-85bd-699fcdd079f3 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.4299ae1f-37df-4387-88b7-177a82813852 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:02 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.4299ae1f-37df-4387-88b7-177a82813852 Jul 07 22:18:02 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:02 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:02 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-0addb98a-bb9c-4ff0-85bd-699fcdd079f3 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086.4299ae1f-37df-4387-88b7-177a82813852" returned: 0 in 0.626s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0addb98a-bb9c-4ff0-85bd-699fcdd079f3 tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-4299ae1f-37df-4387-88b7-177a82813852" released by "_delete_snapshot" :: held 2.956s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:18:02 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0addb98a-bb9c-4ff0-85bd-699fcdd079f3 tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-ed61eaf7-ed39-45f0-bad5-1ac4c342e086" released by "delete_snapshot" :: held 2.979s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:18:02 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-0addb98a-bb9c-4ff0-85bd-699fcdd079f3 tempest-ProjectMemberTests-811768835 None] Created reservations ['f7784d38-eb6e-4381-90d6-b4aa125e9540', '51441ec7-204b-4be0-8151-12bae173d439', '9a7cc178-771d-41e8-98b5-6b6c5b6c59d9', '8e7c9ecb-5ca6-455e-8370-2bc465a0b41b'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:18:03 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-0addb98a-bb9c-4ff0-85bd-699fcdd079f3 tempest-ProjectMemberTests-811768835 None] Delete snapshot completed successfully. Jul 07 22:18:03 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-0addb98a-bb9c-4ff0-85bd-699fcdd079f3 tempest-ProjectMemberTests-811768835 None] Lock "cinder-4299ae1f-37df-4387-88b7-177a82813852-delete_snapshot" released by "delete_snapshot" :: held 3.120s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:18:03 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8b73e1da-270b-46c6-831e-f048a641990e tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-ed61eaf7-ed39-45f0-bad5-1ac4c342e086-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:18:03 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8b73e1da-270b-46c6-831e-f048a641990e tempest-ProjectMemberTests-811768835 None] Lock "cinder-ed61eaf7-ed39-45f0-bad5-1ac4c342e086-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:18:03 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8b73e1da-270b-46c6-831e-f048a641990e tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-ed61eaf7-ed39-45f0-bad5-1ac4c342e086" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:18:03 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8b73e1da-270b-46c6-831e-f048a641990e tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-ed61eaf7-ed39-45f0-bad5-1ac4c342e086" acquired by "delete_volume" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:18:03 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4235994a-a788-41b5-9552-cc54546c43a5]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:18:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8b73e1da-270b-46c6-831e-f048a641990e tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:03 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086 Jul 07 22:18:03 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:03 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8b73e1da-270b-46c6-831e-f048a641990e tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086" returned: 0 in 0.724s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:03 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8b73e1da-270b-46c6-831e-f048a641990e tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:03 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086 Jul 07 22:18:03 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:04 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8b73e1da-270b-46c6-831e-f048a641990e tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-ed61eaf7-ed39-45f0-bad5-1ac4c342e086" returned: 0 in 0.647s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:04 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8b73e1da-270b-46c6-831e-f048a641990e tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-ed61eaf7-ed39-45f0-bad5-1ac4c342e086" released by "delete_volume" :: held 1.431s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:18:04 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-8b73e1da-270b-46c6-831e-f048a641990e tempest-ProjectMemberTests-811768835 None] Created reservations ['7e7488e2-299e-4a59-b062-37452191e746', '8fa9980b-7ed1-45e3-b354-99b106409236', '06b1a80f-ed18-430b-b3a2-bd8ed7b3dd14', 'ecabf8a4-a81e-46ad-ac2b-5721f52e502e'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:18:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8b73e1da-270b-46c6-831e-f048a641990e tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:18:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8b73e1da-270b-46c6-831e-f048a641990e tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:18:04 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8b73e1da-270b-46c6-831e-f048a641990e tempest-ProjectMemberTests-811768835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:18:04 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-8b73e1da-270b-46c6-831e-f048a641990e tempest-ProjectMemberTests-811768835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:18:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-8b73e1da-270b-46c6-831e-f048a641990e tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:18:04 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8b73e1da-270b-46c6-831e-f048a641990e tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:04 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:18:04 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:05 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-8b73e1da-270b-46c6-831e-f048a641990e tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.669s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-8b73e1da-270b-46c6-831e-f048a641990e tempest-ProjectMemberTests-811768835 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:18:05 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-8b73e1da-270b-46c6-831e-f048a641990e tempest-ProjectMemberTests-811768835 None] Deleted volume successfully. Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-8b73e1da-270b-46c6-831e-f048a641990e tempest-ProjectMemberTests-811768835 None] Lock "cinder-ed61eaf7-ed39-45f0-bad5-1ac4c342e086-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Flow 'volume_create_manager' (def16ac8-e45b-4725-887e-b969f619c115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48d6b19-546a-44d1-ad9a-b4d2faeabedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48d6b19-546a-44d1-ad9a-b4d2faeabedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-702557928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4101b467-5d3f-48ff-924f-51d97baa7eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72ec43c2b314ec2b44c0cd84238b6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:18:06Z,use_quota=True,user_id='cc4275e59c51481badff6b228bedd03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c24121-0836-4473-99e0-cf999855b3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c24121-0836-4473-99e0-cf999855b3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99200cd3-c239-4167-918b-aa3b1b0a6817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99200cd3-c239-4167-918b-aa3b1b0a6817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4101b467-5d3f-48ff-924f-51d97baa7eb6', 'volume_name': 'volume-4101b467-5d3f-48ff-924f-51d97baa7eb6', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2caf96e1-904e-44ad-b786-fdc908e397e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2caf96e1-904e-44ad-b786-fdc908e397e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886e10b6-d9e3-457d-9bc8-95148f7f787d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:18:05 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Volume 4101b467-5d3f-48ff-924f-51d97baa7eb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4101b467-5d3f-48ff-924f-51d97baa7eb6', 'volume_size': 1} Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-702557928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4101b467-5d3f-48ff-924f-51d97baa7eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72ec43c2b314ec2b44c0cd84238b6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:18:06Z,use_quota=True,user_id='cc4275e59c51481badff6b228bedd03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Creating volume 4101b467-5d3f-48ff-924f-51d97baa7eb6 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:18:05 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:18:05 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:06 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6 1073741824 Jul 07 22:18:06 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:06 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6 1073741824" returned: 0 in 0.917s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:06 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:06 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6 Jul 07 22:18:06 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:07 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6" returned: 0 in 0.704s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:07 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:18:07 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:18:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886e10b6-d9e3-457d-9bc8-95148f7f787d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4101b467-5d3f-48ff-924f-51d97baa7eb6', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:18:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0701f2-34ea-4dac-84f9-8aa6736b7a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:18:07 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Volume volume-4101b467-5d3f-48ff-924f-51d97baa7eb6 (4101b467-5d3f-48ff-924f-51d97baa7eb6): created successfully Jul 07 22:18:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be0701f2-34ea-4dac-84f9-8aa6736b7a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:18:07 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Flow 'volume_create_manager' (def16ac8-e45b-4725-887e-b969f619c115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:18:07 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ae37bf8f-7d3c-4dc1-b4fa-43d941890523 tempest-ProjectMemberTests-811768835 None] Created volume successfully. Jul 07 22:18:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a86cf4a5-4443-42f7-8e35-73c3a862a3dc tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:18:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a86cf4a5-4443-42f7-8e35-73c3a862a3dc tempest-ProjectMemberTests-811768835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:18:08 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-a86cf4a5-4443-42f7-8e35-73c3a862a3dc tempest-ProjectMemberTests-811768835 None] Creating offline snapshot 0f70521e-9f9f-4f54-b95c-c317cca1c24b of volume 4101b467-5d3f-48ff-924f-51d97baa7eb6 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:18:08 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[47808305-3ee8-4899-9fea-42d15425faf1]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:18:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a86cf4a5-4443-42f7-8e35-73c3a862a3dc tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:08 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6 Jul 07 22:18:08 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:08 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a86cf4a5-4443-42f7-8e35-73c3a862a3dc tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6" returned: 0 in 0.782s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:08 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a86cf4a5-4443-42f7-8e35-73c3a862a3dc tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.0f70521e-9f9f-4f54-b95c-c317cca1c24b 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:09 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.0f70521e-9f9f-4f54-b95c-c317cca1c24b 1G Jul 07 22:18:09 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:09 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a86cf4a5-4443-42f7-8e35-73c3a862a3dc tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.0f70521e-9f9f-4f54-b95c-c317cca1c24b 1G" returned: 0 in 0.824s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:09 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a86cf4a5-4443-42f7-8e35-73c3a862a3dc tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4101b467-5d3f-48ff-924f-51d97baa7eb6 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.0f70521e-9f9f-4f54-b95c-c317cca1c24b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:09 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4101b467-5d3f-48ff-924f-51d97baa7eb6 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.0f70521e-9f9f-4f54-b95c-c317cca1c24b Jul 07 22:18:09 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:10 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a86cf4a5-4443-42f7-8e35-73c3a862a3dc tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4101b467-5d3f-48ff-924f-51d97baa7eb6 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.0f70521e-9f9f-4f54-b95c-c317cca1c24b" returned: 0 in 0.677s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:10 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-a86cf4a5-4443-42f7-8e35-73c3a862a3dc tempest-ProjectMemberTests-811768835 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.0f70521e-9f9f-4f54-b95c-c317cca1c24b is being set with open permissions: ugo+rw Jul 07 22:18:10 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a86cf4a5-4443-42f7-8e35-73c3a862a3dc tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.0f70521e-9f9f-4f54-b95c-c317cca1c24b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:10 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.0f70521e-9f9f-4f54-b95c-c317cca1c24b Jul 07 22:18:10 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:11 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a86cf4a5-4443-42f7-8e35-73c3a862a3dc tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.0f70521e-9f9f-4f54-b95c-c317cca1c24b" returned: 0 in 0.645s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a86cf4a5-4443-42f7-8e35-73c3a862a3dc tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:11 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.info Jul 07 22:18:11 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:11 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a86cf4a5-4443-42f7-8e35-73c3a862a3dc tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.info" returned: 0 in 0.675s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:11 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-a86cf4a5-4443-42f7-8e35-73c3a862a3dc tempest-ProjectMemberTests-811768835 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.info is being set with open permissions: ugo+rw Jul 07 22:18:11 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a86cf4a5-4443-42f7-8e35-73c3a862a3dc tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:11 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.info Jul 07 22:18:11 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:12 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a86cf4a5-4443-42f7-8e35-73c3a862a3dc tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.info" returned: 0 in 0.644s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:12 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a86cf4a5-4443-42f7-8e35-73c3a862a3dc tempest-ProjectMemberTests-811768835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.332s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:18:12 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-a86cf4a5-4443-42f7-8e35-73c3a862a3dc tempest-ProjectMemberTests-811768835 None] Create snapshot completed successfully Jul 07 22:18:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3da2aab9-3cf7-417d-a648-68017c5c7498 tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-0f70521e-9f9f-4f54-b95c-c317cca1c24b-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:18:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3da2aab9-3cf7-417d-a648-68017c5c7498 tempest-ProjectMemberTests-811768835 None] Lock "cinder-0f70521e-9f9f-4f54-b95c-c317cca1c24b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:18:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3da2aab9-3cf7-417d-a648-68017c5c7498 tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-4101b467-5d3f-48ff-924f-51d97baa7eb6" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:18:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3da2aab9-3cf7-417d-a648-68017c5c7498 tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-4101b467-5d3f-48ff-924f-51d97baa7eb6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:18:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3da2aab9-3cf7-417d-a648-68017c5c7498 tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-0f70521e-9f9f-4f54-b95c-c317cca1c24b" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:18:13 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3da2aab9-3cf7-417d-a648-68017c5c7498 tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-0f70521e-9f9f-4f54-b95c-c317cca1c24b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:18:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-3da2aab9-3cf7-417d-a648-68017c5c7498 tempest-ProjectMemberTests-811768835 None] Deleting offline snapshot 0f70521e-9f9f-4f54-b95c-c317cca1c24b of volume 4101b467-5d3f-48ff-924f-51d97baa7eb6 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:18:13 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-3da2aab9-3cf7-417d-a648-68017c5c7498 tempest-ProjectMemberTests-811768835 None] snapshot_file for this snap is: volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.0f70521e-9f9f-4f54-b95c-c317cca1c24b {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:18:13 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fa21cd-2465-4567-bd3b-2d7509bee412]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:18:13 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3da2aab9-3cf7-417d-a648-68017c5c7498 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.0f70521e-9f9f-4f54-b95c-c317cca1c24b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:13 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.0f70521e-9f9f-4f54-b95c-c317cca1c24b Jul 07 22:18:13 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:14 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3da2aab9-3cf7-417d-a648-68017c5c7498 tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.0f70521e-9f9f-4f54-b95c-c317cca1c24b" returned: 0 in 0.705s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-3da2aab9-3cf7-417d-a648-68017c5c7498 tempest-ProjectMemberTests-811768835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4101b467-5d3f-48ff-924f-51d97baa7eb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:18:14 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f14b22-dc20-49b6-95f4-ab360231711a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:18:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3da2aab9-3cf7-417d-a648-68017c5c7498 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:14 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6 Jul 07 22:18:14 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:14 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3da2aab9-3cf7-417d-a648-68017c5c7498 tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6" returned: 0 in 0.740s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3da2aab9-3cf7-417d-a648-68017c5c7498 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.0f70521e-9f9f-4f54-b95c-c317cca1c24b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:14 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.0f70521e-9f9f-4f54-b95c-c317cca1c24b Jul 07 22:18:15 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:15 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3da2aab9-3cf7-417d-a648-68017c5c7498 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.0f70521e-9f9f-4f54-b95c-c317cca1c24b" returned: 0 in 0.713s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3da2aab9-3cf7-417d-a648-68017c5c7498 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.0f70521e-9f9f-4f54-b95c-c317cca1c24b {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:15 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.0f70521e-9f9f-4f54-b95c-c317cca1c24b Jul 07 22:18:15 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:16 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-3da2aab9-3cf7-417d-a648-68017c5c7498 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6.0f70521e-9f9f-4f54-b95c-c317cca1c24b" returned: 0 in 0.640s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3da2aab9-3cf7-417d-a648-68017c5c7498 tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-0f70521e-9f9f-4f54-b95c-c317cca1c24b" released by "_delete_snapshot" :: held 2.880s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:18:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3da2aab9-3cf7-417d-a648-68017c5c7498 tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-4101b467-5d3f-48ff-924f-51d97baa7eb6" released by "delete_snapshot" :: held 2.901s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:18:16 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-3da2aab9-3cf7-417d-a648-68017c5c7498 tempest-ProjectMemberTests-811768835 None] Created reservations ['f7d73b9b-f2d9-49ac-a4c5-286be42fc373', 'ddd24fb9-57e5-4478-94b9-6ff13951e57d', '5403fb33-550c-47a6-b9cb-92f68b182783', '4a9e947d-04dc-4ef0-b21c-468e669dbde1'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:18:16 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-3da2aab9-3cf7-417d-a648-68017c5c7498 tempest-ProjectMemberTests-811768835 None] Delete snapshot completed successfully. Jul 07 22:18:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-3da2aab9-3cf7-417d-a648-68017c5c7498 tempest-ProjectMemberTests-811768835 None] Lock "cinder-0f70521e-9f9f-4f54-b95c-c317cca1c24b-delete_snapshot" released by "delete_snapshot" :: held 3.029s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:18:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-09e86554-90ab-4689-a507-18ceee3624f3 tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-4101b467-5d3f-48ff-924f-51d97baa7eb6-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:18:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-09e86554-90ab-4689-a507-18ceee3624f3 tempest-ProjectMemberTests-811768835 None] Lock "cinder-4101b467-5d3f-48ff-924f-51d97baa7eb6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:18:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-09e86554-90ab-4689-a507-18ceee3624f3 tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-4101b467-5d3f-48ff-924f-51d97baa7eb6" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:18:16 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-09e86554-90ab-4689-a507-18ceee3624f3 tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-4101b467-5d3f-48ff-924f-51d97baa7eb6" acquired by "delete_volume" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:18:16 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d2e344-f01f-4eb5-b848-5776bf0b8c58]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:18:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-09e86554-90ab-4689-a507-18ceee3624f3 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:16 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6 Jul 07 22:18:16 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:17 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-09e86554-90ab-4689-a507-18ceee3624f3 tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6" returned: 0 in 0.768s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-09e86554-90ab-4689-a507-18ceee3624f3 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:17 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6 Jul 07 22:18:17 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:18 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-09e86554-90ab-4689-a507-18ceee3624f3 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-4101b467-5d3f-48ff-924f-51d97baa7eb6" returned: 0 in 0.685s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-09e86554-90ab-4689-a507-18ceee3624f3 tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-4101b467-5d3f-48ff-924f-51d97baa7eb6" released by "delete_volume" :: held 1.511s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:18:18 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-09e86554-90ab-4689-a507-18ceee3624f3 tempest-ProjectMemberTests-811768835 None] Created reservations ['14411d00-760d-437e-bf6c-82ce3a807fd9', '816e30cd-a972-4bee-ae33-094d17f20807', 'f85df014-b933-4192-be42-678f9ecd83c0', '79e5f410-710b-4de4-aa09-a0c829509d98'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:18:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-09e86554-90ab-4689-a507-18ceee3624f3 tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:18:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-09e86554-90ab-4689-a507-18ceee3624f3 tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:18:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-09e86554-90ab-4689-a507-18ceee3624f3 tempest-ProjectMemberTests-811768835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:18:18 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-09e86554-90ab-4689-a507-18ceee3624f3 tempest-ProjectMemberTests-811768835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:18:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-09e86554-90ab-4689-a507-18ceee3624f3 tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:18:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-09e86554-90ab-4689-a507-18ceee3624f3 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:18 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:18:18 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:18 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-09e86554-90ab-4689-a507-18ceee3624f3 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.653s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:18 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-09e86554-90ab-4689-a507-18ceee3624f3 tempest-ProjectMemberTests-811768835 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:18:18 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-09e86554-90ab-4689-a507-18ceee3624f3 tempest-ProjectMemberTests-811768835 None] Deleted volume successfully. Jul 07 22:18:18 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-09e86554-90ab-4689-a507-18ceee3624f3 tempest-ProjectMemberTests-811768835 None] Lock "cinder-4101b467-5d3f-48ff-924f-51d97baa7eb6-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:18:19 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:18:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Flow 'volume_create_manager' (c15663a0-831c-4a3d-b796-d936d6387273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:18:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b1edc7d-3e96-4262-8c89-f429e6e20468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:18:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b1edc7d-3e96-4262-8c89-f429e6e20468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1793339896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a76f9a1-706f-4b08-8b9d-045a4a5755c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72ec43c2b314ec2b44c0cd84238b6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:18:19Z,use_quota=True,user_id='cc4275e59c51481badff6b228bedd03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:18:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0481910-e73d-4e54-8880-3eca7e8be142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:18:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0481910-e73d-4e54-8880-3eca7e8be142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:18:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d544a47-c6a3-44e7-8b5e-8cb5094a65c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:18:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d544a47-c6a3-44e7-8b5e-8cb5094a65c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a76f9a1-706f-4b08-8b9d-045a4a5755c4', 'volume_name': 'volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:18:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9033629-a9c7-46e6-b3a7-685a6618dcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:18:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9033629-a9c7-46e6-b3a7-685a6618dcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:18:19 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43655471-5b65-4ebf-b964-c1ef8cf09ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:18:19 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Volume 8a76f9a1-706f-4b08-8b9d-045a4a5755c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4', 'volume_size': 1} Jul 07 22:18:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:18:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:18:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1793339896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a76f9a1-706f-4b08-8b9d-045a4a5755c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72ec43c2b314ec2b44c0cd84238b6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:18:19Z,use_quota=True,user_id='cc4275e59c51481badff6b228bedd03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:18:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Creating volume 8a76f9a1-706f-4b08-8b9d-045a4a5755c4 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:18:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:18:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:18:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:18:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:18:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:18:19 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:18:19 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:18:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:19 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4 1073741824 Jul 07 22:18:19 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:20 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4 1073741824" returned: 0 in 0.826s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:20 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4 Jul 07 22:18:20 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:20 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4" returned: 0 in 0.652s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:20 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:18:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:18:20 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43655471-5b65-4ebf-b964-c1ef8cf09ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:18:20 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4c2302-24ed-45e0-8d6d-2cf2b09018b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:18:21 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Volume volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4 (8a76f9a1-706f-4b08-8b9d-045a4a5755c4): created successfully Jul 07 22:18:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4c2302-24ed-45e0-8d6d-2cf2b09018b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:18:21 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Flow 'volume_create_manager' (c15663a0-831c-4a3d-b796-d936d6387273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:18:21 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-98c1f7d6-47f4-480e-9985-d9b9f68e5f06 tempest-ProjectMemberTests-811768835 None] Created volume successfully. Jul 07 22:18:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5a55aac2-77a2-4e14-ac40-2ef103bfa5db tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:18:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5a55aac2-77a2-4e14-ac40-2ef103bfa5db tempest-ProjectMemberTests-811768835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:18:21 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-5a55aac2-77a2-4e14-ac40-2ef103bfa5db tempest-ProjectMemberTests-811768835 None] Creating offline snapshot 24adb626-2750-4de3-8173-8129bdfcee3d of volume 8a76f9a1-706f-4b08-8b9d-045a4a5755c4 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:18:21 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[448fb659-9b70-48e5-a545-88445b51fd99]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:18:21 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a55aac2-77a2-4e14-ac40-2ef103bfa5db tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:21 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4 Jul 07 22:18:21 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:22 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a55aac2-77a2-4e14-ac40-2ef103bfa5db tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4" returned: 0 in 0.769s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a55aac2-77a2-4e14-ac40-2ef103bfa5db tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.24adb626-2750-4de3-8173-8129bdfcee3d 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:22 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.24adb626-2750-4de3-8173-8129bdfcee3d 1G Jul 07 22:18:22 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:23 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a55aac2-77a2-4e14-ac40-2ef103bfa5db tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.24adb626-2750-4de3-8173-8129bdfcee3d 1G" returned: 0 in 0.798s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a55aac2-77a2-4e14-ac40-2ef103bfa5db tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.24adb626-2750-4de3-8173-8129bdfcee3d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:23 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.24adb626-2750-4de3-8173-8129bdfcee3d Jul 07 22:18:23 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:23 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a55aac2-77a2-4e14-ac40-2ef103bfa5db tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.24adb626-2750-4de3-8173-8129bdfcee3d" returned: 0 in 0.656s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:23 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-5a55aac2-77a2-4e14-ac40-2ef103bfa5db tempest-ProjectMemberTests-811768835 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.24adb626-2750-4de3-8173-8129bdfcee3d is being set with open permissions: ugo+rw Jul 07 22:18:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a55aac2-77a2-4e14-ac40-2ef103bfa5db tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.24adb626-2750-4de3-8173-8129bdfcee3d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:23 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.24adb626-2750-4de3-8173-8129bdfcee3d Jul 07 22:18:23 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:24 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a55aac2-77a2-4e14-ac40-2ef103bfa5db tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.24adb626-2750-4de3-8173-8129bdfcee3d" returned: 0 in 0.613s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a55aac2-77a2-4e14-ac40-2ef103bfa5db tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:24 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.info Jul 07 22:18:24 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:25 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a55aac2-77a2-4e14-ac40-2ef103bfa5db tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.info" returned: 0 in 0.596s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:25 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-5a55aac2-77a2-4e14-ac40-2ef103bfa5db tempest-ProjectMemberTests-811768835 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.info is being set with open permissions: ugo+rw Jul 07 22:18:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a55aac2-77a2-4e14-ac40-2ef103bfa5db tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:25 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.info Jul 07 22:18:25 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:25 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-5a55aac2-77a2-4e14-ac40-2ef103bfa5db tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.info" returned: 0 in 0.635s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:25 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-5a55aac2-77a2-4e14-ac40-2ef103bfa5db tempest-ProjectMemberTests-811768835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.151s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:18:25 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-5a55aac2-77a2-4e14-ac40-2ef103bfa5db tempest-ProjectMemberTests-811768835 None] Create snapshot completed successfully Jul 07 22:18:26 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b34fd315-b21d-45a7-a5ff-d34efb22c64d tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-24adb626-2750-4de3-8173-8129bdfcee3d-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:18:26 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b34fd315-b21d-45a7-a5ff-d34efb22c64d tempest-ProjectMemberTests-811768835 None] Lock "cinder-24adb626-2750-4de3-8173-8129bdfcee3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:18:26 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b34fd315-b21d-45a7-a5ff-d34efb22c64d tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-8a76f9a1-706f-4b08-8b9d-045a4a5755c4" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:18:26 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b34fd315-b21d-45a7-a5ff-d34efb22c64d tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-8a76f9a1-706f-4b08-8b9d-045a4a5755c4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:18:26 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b34fd315-b21d-45a7-a5ff-d34efb22c64d tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-24adb626-2750-4de3-8173-8129bdfcee3d" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:18:26 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b34fd315-b21d-45a7-a5ff-d34efb22c64d tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-24adb626-2750-4de3-8173-8129bdfcee3d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:18:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-b34fd315-b21d-45a7-a5ff-d34efb22c64d tempest-ProjectMemberTests-811768835 None] Deleting offline snapshot 24adb626-2750-4de3-8173-8129bdfcee3d of volume 8a76f9a1-706f-4b08-8b9d-045a4a5755c4 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:18:26 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-b34fd315-b21d-45a7-a5ff-d34efb22c64d tempest-ProjectMemberTests-811768835 None] snapshot_file for this snap is: volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.24adb626-2750-4de3-8173-8129bdfcee3d {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:18:26 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[007b5eba-2c90-413c-ae41-e2e1712dce23]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:18:26 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b34fd315-b21d-45a7-a5ff-d34efb22c64d tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.24adb626-2750-4de3-8173-8129bdfcee3d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:26 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.24adb626-2750-4de3-8173-8129bdfcee3d Jul 07 22:18:26 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:27 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b34fd315-b21d-45a7-a5ff-d34efb22c64d tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.24adb626-2750-4de3-8173-8129bdfcee3d" returned: 0 in 0.764s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:27 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-b34fd315-b21d-45a7-a5ff-d34efb22c64d tempest-ProjectMemberTests-811768835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:18:27 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a90342-43d3-4dd3-9802-69958970fbf8]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:18:27 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b34fd315-b21d-45a7-a5ff-d34efb22c64d tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:27 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4 Jul 07 22:18:27 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:28 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b34fd315-b21d-45a7-a5ff-d34efb22c64d tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4" returned: 0 in 0.733s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b34fd315-b21d-45a7-a5ff-d34efb22c64d tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.24adb626-2750-4de3-8173-8129bdfcee3d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:28 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.24adb626-2750-4de3-8173-8129bdfcee3d Jul 07 22:18:28 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:29 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b34fd315-b21d-45a7-a5ff-d34efb22c64d tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.24adb626-2750-4de3-8173-8129bdfcee3d" returned: 0 in 0.710s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b34fd315-b21d-45a7-a5ff-d34efb22c64d tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.24adb626-2750-4de3-8173-8129bdfcee3d {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:29 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.24adb626-2750-4de3-8173-8129bdfcee3d Jul 07 22:18:29 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:29 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b34fd315-b21d-45a7-a5ff-d34efb22c64d tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4.24adb626-2750-4de3-8173-8129bdfcee3d" returned: 0 in 0.644s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b34fd315-b21d-45a7-a5ff-d34efb22c64d tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-24adb626-2750-4de3-8173-8129bdfcee3d" released by "_delete_snapshot" :: held 2.948s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:18:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b34fd315-b21d-45a7-a5ff-d34efb22c64d tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-8a76f9a1-706f-4b08-8b9d-045a4a5755c4" released by "delete_snapshot" :: held 2.971s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:18:29 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-b34fd315-b21d-45a7-a5ff-d34efb22c64d tempest-ProjectMemberTests-811768835 None] Created reservations ['05c665ed-53d8-400c-b625-90c4f3ed4bcc', '9136e835-ebf1-4180-a046-ca55c5a4dd08', '72c35b01-a5d7-46da-a721-d69de7623835', '0d3c78e4-b40f-4fe0-b9c9-b9c012084404'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:18:29 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-b34fd315-b21d-45a7-a5ff-d34efb22c64d tempest-ProjectMemberTests-811768835 None] Delete snapshot completed successfully. Jul 07 22:18:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b34fd315-b21d-45a7-a5ff-d34efb22c64d tempest-ProjectMemberTests-811768835 None] Lock "cinder-24adb626-2750-4de3-8173-8129bdfcee3d-delete_snapshot" released by "delete_snapshot" :: held 3.131s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:18:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1d87d9c1-67dd-46bf-8a11-547ee5eccd63 tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-8a76f9a1-706f-4b08-8b9d-045a4a5755c4-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:18:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1d87d9c1-67dd-46bf-8a11-547ee5eccd63 tempest-ProjectMemberTests-811768835 None] Lock "cinder-8a76f9a1-706f-4b08-8b9d-045a4a5755c4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:18:30 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1d87d9c1-67dd-46bf-8a11-547ee5eccd63 tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-8a76f9a1-706f-4b08-8b9d-045a4a5755c4" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:18:30 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1d87d9c1-67dd-46bf-8a11-547ee5eccd63 tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-8a76f9a1-706f-4b08-8b9d-045a4a5755c4" acquired by "delete_volume" :: waited 0.016s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:18:30 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22b355a-c36b-4c30-832e-cd9453465c8d]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:18:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1d87d9c1-67dd-46bf-8a11-547ee5eccd63 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:30 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4 Jul 07 22:18:30 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:30 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1d87d9c1-67dd-46bf-8a11-547ee5eccd63 tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4" returned: 0 in 0.756s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1d87d9c1-67dd-46bf-8a11-547ee5eccd63 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:30 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4 Jul 07 22:18:30 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:31 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1d87d9c1-67dd-46bf-8a11-547ee5eccd63 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-8a76f9a1-706f-4b08-8b9d-045a4a5755c4" returned: 0 in 0.651s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:31 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1d87d9c1-67dd-46bf-8a11-547ee5eccd63 tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-8a76f9a1-706f-4b08-8b9d-045a4a5755c4" released by "delete_volume" :: held 1.464s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:18:31 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-1d87d9c1-67dd-46bf-8a11-547ee5eccd63 tempest-ProjectMemberTests-811768835 None] Created reservations ['0d926a6c-19c3-45bd-bf69-9b7a53180441', '962b4d20-9976-4ba0-92cb-6f8d594b6742', '2f3f6afb-06ca-4a99-9399-440c7dbde6ea', 'ef23f561-6fa5-441a-92d1-39585057364a'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:18:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1d87d9c1-67dd-46bf-8a11-547ee5eccd63 tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:18:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1d87d9c1-67dd-46bf-8a11-547ee5eccd63 tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:18:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1d87d9c1-67dd-46bf-8a11-547ee5eccd63 tempest-ProjectMemberTests-811768835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:18:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1d87d9c1-67dd-46bf-8a11-547ee5eccd63 tempest-ProjectMemberTests-811768835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:18:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1d87d9c1-67dd-46bf-8a11-547ee5eccd63 tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:18:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1d87d9c1-67dd-46bf-8a11-547ee5eccd63 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:31 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:18:31 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:32 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1d87d9c1-67dd-46bf-8a11-547ee5eccd63 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.673s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-1d87d9c1-67dd-46bf-8a11-547ee5eccd63 tempest-ProjectMemberTests-811768835 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:18:32 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-1d87d9c1-67dd-46bf-8a11-547ee5eccd63 tempest-ProjectMemberTests-811768835 None] Deleted volume successfully. Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-1d87d9c1-67dd-46bf-8a11-547ee5eccd63 tempest-ProjectMemberTests-811768835 None] Lock "cinder-8a76f9a1-706f-4b08-8b9d-045a4a5755c4-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Flow 'volume_create_manager' (c6f41c16-6cde-4680-a7fe-b6d4e00442ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8190ed24-578b-4235-8002-eba7d74c827d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8190ed24-578b-4235-8002-eba7d74c827d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1062762275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0fc08a3-3a73-4ba2-bf97-2846f2a0e256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72ec43c2b314ec2b44c0cd84238b6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:18:33Z,use_quota=True,user_id='cc4275e59c51481badff6b228bedd03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (555f0e69-4d55-4e2a-804b-8f3567b7a473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (555f0e69-4d55-4e2a-804b-8f3567b7a473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3134d952-6a07-4bea-a846-c344d06907e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3134d952-6a07-4bea-a846-c344d06907e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0fc08a3-3a73-4ba2-bf97-2846f2a0e256', 'volume_name': 'volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (072ce098-f128-47a5-bbe2-6f5b65ccb655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (072ce098-f128-47a5-bbe2-6f5b65ccb655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f489840-efa5-4cea-808a-f51b7f319e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:18:32 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Volume e0fc08a3-3a73-4ba2-bf97-2846f2a0e256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256', 'volume_size': 1} Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1062762275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0fc08a3-3a73-4ba2-bf97-2846f2a0e256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72ec43c2b314ec2b44c0cd84238b6a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:18:33Z,use_quota=True,user_id='cc4275e59c51481badff6b228bedd03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Creating volume e0fc08a3-3a73-4ba2-bf97-2846f2a0e256 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:18:32 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:18:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:32 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256 1073741824 Jul 07 22:18:32 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:33 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256 1073741824" returned: 0 in 0.893s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:33 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256 Jul 07 22:18:33 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:34 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256" returned: 0 in 0.677s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:18:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:18:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f489840-efa5-4cea-808a-f51b7f319e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:18:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ad8541-fc7f-46b9-93e0-0a90e854c42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:18:34 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Volume volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256 (e0fc08a3-3a73-4ba2-bf97-2846f2a0e256): created successfully Jul 07 22:18:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ad8541-fc7f-46b9-93e0-0a90e854c42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:18:34 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Flow 'volume_create_manager' (c6f41c16-6cde-4680-a7fe-b6d4e00442ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:18:34 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-1e660f78-794c-4b7d-bed1-746eaa301650 tempest-ProjectMemberTests-811768835 None] Created volume successfully. Jul 07 22:18:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a17950ad-8cfc-4311-97f9-1e5ec3a7dc33 tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:18:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a17950ad-8cfc-4311-97f9-1e5ec3a7dc33 tempest-ProjectMemberTests-811768835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:18:34 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-a17950ad-8cfc-4311-97f9-1e5ec3a7dc33 tempest-ProjectMemberTests-811768835 None] Creating offline snapshot c465fc2b-15ee-4883-93e8-c4f51a10fe6c of volume e0fc08a3-3a73-4ba2-bf97-2846f2a0e256 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:18:34 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4437fa-2a19-4d1b-b0c5-97b318645724]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:18:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a17950ad-8cfc-4311-97f9-1e5ec3a7dc33 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:35 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256 Jul 07 22:18:35 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:18:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:18:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:18:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:18:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:18:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:18:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:35 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:18:35 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:35 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a17950ad-8cfc-4311-97f9-1e5ec3a7dc33 tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256" returned: 0 in 0.791s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a17950ad-8cfc-4311-97f9-1e5ec3a7dc33 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.c465fc2b-15ee-4883-93e8-c4f51a10fe6c 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:35 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.c465fc2b-15ee-4883-93e8-c4f51a10fe6c 1G Jul 07 22:18:35 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:36 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.806s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:18:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:18:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 28 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 22:18:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 22:18:36 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a17950ad-8cfc-4311-97f9-1e5ec3a7dc33 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.c465fc2b-15ee-4883-93e8-c4f51a10fe6c 1G" returned: 0 in 0.862s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a17950ad-8cfc-4311-97f9-1e5ec3a7dc33 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.c465fc2b-15ee-4883-93e8-c4f51a10fe6c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:36 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.c465fc2b-15ee-4883-93e8-c4f51a10fe6c Jul 07 22:18:36 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:37 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a17950ad-8cfc-4311-97f9-1e5ec3a7dc33 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.c465fc2b-15ee-4883-93e8-c4f51a10fe6c" returned: 0 in 0.677s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:37 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-a17950ad-8cfc-4311-97f9-1e5ec3a7dc33 tempest-ProjectMemberTests-811768835 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.c465fc2b-15ee-4883-93e8-c4f51a10fe6c is being set with open permissions: ugo+rw Jul 07 22:18:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a17950ad-8cfc-4311-97f9-1e5ec3a7dc33 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.c465fc2b-15ee-4883-93e8-c4f51a10fe6c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:37 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.c465fc2b-15ee-4883-93e8-c4f51a10fe6c Jul 07 22:18:37 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:37 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a17950ad-8cfc-4311-97f9-1e5ec3a7dc33 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.c465fc2b-15ee-4883-93e8-c4f51a10fe6c" returned: 0 in 0.640s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a17950ad-8cfc-4311-97f9-1e5ec3a7dc33 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:38 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.info Jul 07 22:18:38 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:38 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a17950ad-8cfc-4311-97f9-1e5ec3a7dc33 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.info" returned: 0 in 0.689s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:38 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-a17950ad-8cfc-4311-97f9-1e5ec3a7dc33 tempest-ProjectMemberTests-811768835 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.info is being set with open permissions: ugo+rw Jul 07 22:18:38 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a17950ad-8cfc-4311-97f9-1e5ec3a7dc33 tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:38 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.info Jul 07 22:18:38 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:39 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-a17950ad-8cfc-4311-97f9-1e5ec3a7dc33 tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.info" returned: 0 in 0.660s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:39 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-a17950ad-8cfc-4311-97f9-1e5ec3a7dc33 tempest-ProjectMemberTests-811768835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.406s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:18:39 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-a17950ad-8cfc-4311-97f9-1e5ec3a7dc33 tempest-ProjectMemberTests-811768835 None] Create snapshot completed successfully Jul 07 22:18:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d05f6d6e-4761-457f-be05-931ad5c9d92e tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-c465fc2b-15ee-4883-93e8-c4f51a10fe6c-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:18:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d05f6d6e-4761-457f-be05-931ad5c9d92e tempest-ProjectMemberTests-811768835 None] Lock "cinder-c465fc2b-15ee-4883-93e8-c4f51a10fe6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:18:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d05f6d6e-4761-457f-be05-931ad5c9d92e tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:18:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d05f6d6e-4761-457f-be05-931ad5c9d92e tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:18:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d05f6d6e-4761-457f-be05-931ad5c9d92e tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-c465fc2b-15ee-4883-93e8-c4f51a10fe6c" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:18:40 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d05f6d6e-4761-457f-be05-931ad5c9d92e tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-c465fc2b-15ee-4883-93e8-c4f51a10fe6c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:18:40 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-d05f6d6e-4761-457f-be05-931ad5c9d92e tempest-ProjectMemberTests-811768835 None] Deleting offline snapshot c465fc2b-15ee-4883-93e8-c4f51a10fe6c of volume e0fc08a3-3a73-4ba2-bf97-2846f2a0e256 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:18:40 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-d05f6d6e-4761-457f-be05-931ad5c9d92e tempest-ProjectMemberTests-811768835 None] snapshot_file for this snap is: volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.c465fc2b-15ee-4883-93e8-c4f51a10fe6c {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:18:40 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25fdbea-5030-440a-8ee0-175a3fdd3e53]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:18:40 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d05f6d6e-4761-457f-be05-931ad5c9d92e tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.c465fc2b-15ee-4883-93e8-c4f51a10fe6c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:40 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.c465fc2b-15ee-4883-93e8-c4f51a10fe6c Jul 07 22:18:40 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:41 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d05f6d6e-4761-457f-be05-931ad5c9d92e tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.c465fc2b-15ee-4883-93e8-c4f51a10fe6c" returned: 0 in 0.772s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:41 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-d05f6d6e-4761-457f-be05-931ad5c9d92e tempest-ProjectMemberTests-811768835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:18:41 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfce1444-88c1-4cca-a42f-11072fa5aea0]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:18:41 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d05f6d6e-4761-457f-be05-931ad5c9d92e tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:41 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256 Jul 07 22:18:41 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:42 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d05f6d6e-4761-457f-be05-931ad5c9d92e tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256" returned: 0 in 0.778s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d05f6d6e-4761-457f-be05-931ad5c9d92e tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.c465fc2b-15ee-4883-93e8-c4f51a10fe6c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:42 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.c465fc2b-15ee-4883-93e8-c4f51a10fe6c Jul 07 22:18:42 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:42 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d05f6d6e-4761-457f-be05-931ad5c9d92e tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.c465fc2b-15ee-4883-93e8-c4f51a10fe6c" returned: 0 in 0.751s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:42 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d05f6d6e-4761-457f-be05-931ad5c9d92e tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.c465fc2b-15ee-4883-93e8-c4f51a10fe6c {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:42 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.c465fc2b-15ee-4883-93e8-c4f51a10fe6c Jul 07 22:18:42 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:43 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:43 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-d05f6d6e-4761-457f-be05-931ad5c9d92e tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256.c465fc2b-15ee-4883-93e8-c4f51a10fe6c" returned: 0 in 0.651s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d05f6d6e-4761-457f-be05-931ad5c9d92e tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-c465fc2b-15ee-4883-93e8-c4f51a10fe6c" released by "_delete_snapshot" :: held 3.075s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:18:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d05f6d6e-4761-457f-be05-931ad5c9d92e tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256" released by "delete_snapshot" :: held 3.108s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:18:43 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-d05f6d6e-4761-457f-be05-931ad5c9d92e tempest-ProjectMemberTests-811768835 None] Created reservations ['527d160d-05fe-4481-bd8d-70fa089f53fb', 'e5b99cea-5437-4ec1-8029-2beb995175b0', 'ac80faab-1f60-494a-b58e-22967c405b2a', '751a2b4d-2150-4a76-b1f7-9c9e2c98c930'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:18:43 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-d05f6d6e-4761-457f-be05-931ad5c9d92e tempest-ProjectMemberTests-811768835 None] Delete snapshot completed successfully. Jul 07 22:18:43 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-d05f6d6e-4761-457f-be05-931ad5c9d92e tempest-ProjectMemberTests-811768835 None] Lock "cinder-c465fc2b-15ee-4883-93e8-c4f51a10fe6c-delete_snapshot" released by "delete_snapshot" :: held 3.262s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:18:44 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-634dda2d-8cf9-4e76-9347-31608a7c9f0a tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:18:44 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-634dda2d-8cf9-4e76-9347-31608a7c9f0a tempest-ProjectMemberTests-811768835 None] Lock "cinder-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:18:44 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-634dda2d-8cf9-4e76-9347-31608a7c9f0a tempest-ProjectMemberTests-811768835 None] Acquiring lock "cinder-quobyte-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:18:44 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-634dda2d-8cf9-4e76-9347-31608a7c9f0a tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256" acquired by "delete_volume" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:18:44 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2907df9-a53f-4d6e-94e4-48704ac538e0]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:18:44 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-634dda2d-8cf9-4e76-9347-31608a7c9f0a tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:44 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256 Jul 07 22:18:44 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:45 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-634dda2d-8cf9-4e76-9347-31608a7c9f0a tempest-ProjectMemberTests-811768835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256" returned: 0 in 0.861s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:45 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-634dda2d-8cf9-4e76-9347-31608a7c9f0a tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:45 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256 Jul 07 22:18:45 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:46 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-634dda2d-8cf9-4e76-9347-31608a7c9f0a tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256" returned: 0 in 0.673s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:46 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-634dda2d-8cf9-4e76-9347-31608a7c9f0a tempest-ProjectMemberTests-811768835 None] Lock "cinder-quobyte-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256" released by "delete_volume" :: held 1.596s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:18:46 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-634dda2d-8cf9-4e76-9347-31608a7c9f0a tempest-ProjectMemberTests-811768835 None] Created reservations ['7a09781c-7c47-4d2b-a8d7-f30ec94d574d', '0e3d906e-d303-4065-ad00-d70a5fc417cd', '506448b3-3b1d-4511-b6e1-b95866ff98d2', 'c2eca290-667f-49ae-8781-b514dc2d2b32'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:18:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-634dda2d-8cf9-4e76-9347-31608a7c9f0a tempest-ProjectMemberTests-811768835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:18:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-634dda2d-8cf9-4e76-9347-31608a7c9f0a tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:18:46 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-634dda2d-8cf9-4e76-9347-31608a7c9f0a tempest-ProjectMemberTests-811768835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:18:46 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-634dda2d-8cf9-4e76-9347-31608a7c9f0a tempest-ProjectMemberTests-811768835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:18:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-634dda2d-8cf9-4e76-9347-31608a7c9f0a tempest-ProjectMemberTests-811768835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:18:46 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-634dda2d-8cf9-4e76-9347-31608a7c9f0a tempest-ProjectMemberTests-811768835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:18:46 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:18:46 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:18:47 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Jul 07 22:18:47 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-634dda2d-8cf9-4e76-9347-31608a7c9f0a tempest-ProjectMemberTests-811768835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.682s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:18:47 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-634dda2d-8cf9-4e76-9347-31608a7c9f0a tempest-ProjectMemberTests-811768835 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:18:47 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-634dda2d-8cf9-4e76-9347-31608a7c9f0a tempest-ProjectMemberTests-811768835 None] Deleted volume successfully. Jul 07 22:18:47 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-634dda2d-8cf9-4e76-9347-31608a7c9f0a tempest-ProjectMemberTests-811768835 None] Lock "cinder-e0fc08a3-3a73-4ba2-bf97-2846f2a0e256-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:18:56 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:DELETE=5,cinder:SELECT=47,cinder:INSERT=24,cinder:UPDATE=66 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:18:57 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=56,cinder:INSERT=14,cinder:UPDATE=69,cinder:DELETE=6 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:19:14 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:19:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Flow 'volume_create_manager' (df717f3c-5a0c-418f-a729-91f09666d0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:19:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c31169-b422-41e5-ba40-d278cdd32d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:19:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c31169-b422-41e5-ba40-d278cdd32d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1831661567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3918315e-4d4e-40f7-87f6-30ce687b0ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9555ea0550d49f9a08635a3248eae7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:19:14Z,use_quota=True,user_id='95c81b55706f426aa67cc9b2bae3e0bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:19:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859738f7-2a8e-42c2-8183-73dc6d491a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:19:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859738f7-2a8e-42c2-8183-73dc6d491a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:19:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e0ef02-dbea-4103-aa85-373e9d6548c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:19:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e0ef02-dbea-4103-aa85-373e9d6548c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3918315e-4d4e-40f7-87f6-30ce687b0ec8', 'volume_name': 'volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:19:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d595a6bd-113e-4201-875d-20fe93abaea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:19:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d595a6bd-113e-4201-875d-20fe93abaea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:19:14 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c2702d8-175d-49fe-8d2b-0a112365fefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:19:14 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Volume 3918315e-4d4e-40f7-87f6-30ce687b0ec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8', 'volume_size': 1} Jul 07 22:19:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:19:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:19:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1831661567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3918315e-4d4e-40f7-87f6-30ce687b0ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9555ea0550d49f9a08635a3248eae7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:19:14Z,use_quota=True,user_id='95c81b55706f426aa67cc9b2bae3e0bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)}" {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 22:19:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Creating volume 3918315e-4d4e-40f7-87f6-30ce687b0ec8 {{(pid=87586) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 22:19:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:19:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:19:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:19:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:19:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:19:14 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:19:14 devstack cinder-volume[87586]: INFO cinder.volume.drivers.remotefs [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] casted to osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 Jul 07 22:19:14 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 1073741824 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:14 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 1073741824 Jul 07 22:19:14 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:15 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 1073741824" returned: 0 in 0.774s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:15 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:15 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 Jul 07 22:19:15 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:16 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8" returned: 0 in 0.602s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'} {{(pid=87586) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 22:19:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:19:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c2702d8-175d-49fe-8d2b-0a112365fefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8', 'volume_size': 1}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:19:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e071860c-1fac-494b-8071-bb56dfc36911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:19:16 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Volume volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 (3918315e-4d4e-40f7-87f6-30ce687b0ec8): created successfully Jul 07 22:19:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e071860c-1fac-494b-8071-bb56dfc36911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:19:16 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Flow 'volume_create_manager' (df717f3c-5a0c-418f-a729-91f09666d0d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:19:16 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-4efe64d1-6280-44cb-b254-438546d139b1 tempest-SnapshotDependencyTests-352042485 None] Created volume successfully. Jul 07 22:19:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-78201455-b735-4151-b97e-4cb282f42b15 tempest-SnapshotDependencyTests-352042485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:19:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-78201455-b735-4151-b97e-4cb282f42b15 tempest-SnapshotDependencyTests-352042485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:19:16 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-78201455-b735-4151-b97e-4cb282f42b15 tempest-SnapshotDependencyTests-352042485 None] Creating offline snapshot f14121d8-ee79-4e5a-9e5a-0de2c43d6743 of volume 3918315e-4d4e-40f7-87f6-30ce687b0ec8 {{(pid=87586) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 22:19:16 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b21494-f361-444c-9bf6-3b8c8eacfb9e]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:19:16 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-78201455-b735-4151-b97e-4cb282f42b15 tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:16 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 Jul 07 22:19:16 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:17 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-78201455-b735-4151-b97e-4cb282f42b15 tempest-SnapshotDependencyTests-352042485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8" returned: 0 in 0.728s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:17 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-78201455-b735-4151-b97e-4cb282f42b15 tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743 1G {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:17 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743 1G Jul 07 22:19:17 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:18 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-78201455-b735-4151-b97e-4cb282f42b15 tempest-SnapshotDependencyTests-352042485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743 1G" returned: 0 in 0.749s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:18 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-78201455-b735-4151-b97e-4cb282f42b15 tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:18 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743 Jul 07 22:19:18 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:19 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-78201455-b735-4151-b97e-4cb282f42b15 tempest-SnapshotDependencyTests-352042485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 -F qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743" returned: 0 in 0.745s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:19 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-78201455-b735-4151-b97e-4cb282f42b15 tempest-SnapshotDependencyTests-352042485 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743 is being set with open permissions: ugo+rw Jul 07 22:19:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-78201455-b735-4151-b97e-4cb282f42b15 tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:19 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743 Jul 07 22:19:19 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:19 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-78201455-b735-4151-b97e-4cb282f42b15 tempest-SnapshotDependencyTests-352042485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743" returned: 0 in 0.650s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:19 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-78201455-b735-4151-b97e-4cb282f42b15 tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:19 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.info Jul 07 22:19:19 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:20 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-78201455-b735-4151-b97e-4cb282f42b15 tempest-SnapshotDependencyTests-352042485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.info" returned: 0 in 0.619s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:20 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-78201455-b735-4151-b97e-4cb282f42b15 tempest-SnapshotDependencyTests-352042485 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.info is being set with open permissions: ugo+rw Jul 07 22:19:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-78201455-b735-4151-b97e-4cb282f42b15 tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.info {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:20 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.info Jul 07 22:19:20 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:20 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-78201455-b735-4151-b97e-4cb282f42b15 tempest-SnapshotDependencyTests-352042485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.info" returned: 0 in 0.607s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:20 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-78201455-b735-4151-b97e-4cb282f42b15 tempest-SnapshotDependencyTests-352042485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.178s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:19:21 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-78201455-b735-4151-b97e-4cb282f42b15 tempest-SnapshotDependencyTests-352042485 None] Create snapshot completed successfully Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87586) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Flow 'volume_create_manager' (20a1733e-60a5-4073-bf15-6bf7f21c640a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9675cde-505d-4c47-85e2-a62878ec6fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9675cde-505d-4c47-85e2-a62878ec6fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T20:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0429001-f580-42a8-b019-1eca48228844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9555ea0550d49f9a08635a3248eae7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f14121d8-ee79-4e5a-9e5a-0de2c43d6743,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:19:23Z,use_quota=True,user_id='95c81b55706f426aa67cc9b2bae3e0bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(679c90a3-306b-4977-bad3-b9ab550493e0),volume_type_id=679c90a3-306b-4977-bad3-b9ab550493e0)' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0465c106-4ab4-4687-bb22-0ba29847b482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0465c106-4ab4-4687-bb22-0ba29847b482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f7e248-7a60-4de6-9d67-6e1d130435f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f7e248-7a60-4de6-9d67-6e1d130435f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c0429001-f580-42a8-b019-1eca48228844', 'volume_name': 'volume-c0429001-f580-42a8-b019-1eca48228844', 'volume_size': 1, 'snapshot_id': 'f14121d8-ee79-4e5a-9e5a-0de2c43d6743'}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16830d6c-e08a-4370-82b5-55b4a21a2d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16830d6c-e08a-4370-82b5-55b4a21a2d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104db295-1a54-4880-8f1e-5007ffc20350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:19:22 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Volume c0429001-f580-42a8-b019-1eca48228844: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c0429001-f580-42a8-b019-1eca48228844', 'volume_size': 1, 'snapshot_id': 'f14121d8-ee79-4e5a-9e5a-0de2c43d6743'} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Acquiring lock "cinder-quobyte-f14121d8-ee79-4e5a-9e5a-0de2c43d6743-c0429001-f580-42a8-b019-1eca48228844" by "_create_volume_from_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Lock "cinder-quobyte-f14121d8-ee79-4e5a-9e5a-0de2c43d6743-c0429001-f580-42a8-b019-1eca48228844" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Creating volume c0429001-f580-42a8-b019-1eca48228844 from snapshot f14121d8-ee79-4e5a-9e5a-0de2c43d6743 {{(pid=87586) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Selected osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491 as target Quobyte volume. {{(pid=87586) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Acquiring lock "cinder-quobyte-c0429001-f580-42a8-b019-1eca48228844" by "_copy_volume_from_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Lock "cinder-quobyte-c0429001-f580-42a8-b019-1eca48228844" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] snapshot: f14121d8-ee79-4e5a-9e5a-0de2c43d6743, volume: c0429001-f580-42a8-b019-1eca48228844, {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a684aa-fce1-4bd3-a6bc-80a3a7cdf8bf]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:19:22 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:22 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743 Jul 07 22:19:22 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:23 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743" returned: 0 in 0.736s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:19:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 22:19:23 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Creating direct copy from snapshot {{(pid=87586) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 22:19:23 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[136bc000-d6d3-49c6-8ce2-30d28df8603a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:19:23 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:23 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 Jul 07 22:19:23 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:24 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8" returned: 0 in 0.735s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:24 devstack cinder-volume[87586]: DEBUG cinder.utils [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Path /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0429001-f580-42a8-b019-1eca48228844 not found in is_blk_device check {{(pid=87586) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 22:19:24 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0429001-f580-42a8-b019-1eca48228844 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:24 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0429001-f580-42a8-b019-1eca48228844 Jul 07 22:19:24 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:28 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0429001-f580-42a8-b019-1eca48228844" returned: 0 in 4.190s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:28 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[69677528-eb96-4f69-bd4d-12d524cf7d68]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:19:28 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:28 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 Jul 07 22:19:28 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:29 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8" returned: 0 in 0.886s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:29 devstack cinder-volume[87586]: DEBUG cinder.image.image_utils [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Image conversion details: src /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8, size 1024.00 MB, duration 4.19 sec, destination /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0429001-f580-42a8-b019-1eca48228844 {{(pid=87586) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 22:19:29 devstack cinder-volume[87586]: INFO cinder.image.image_utils [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Converted 1024.00 MB image at 244.28 MB/s Jul 07 22:19:29 devstack cinder-volume[87586]: WARNING cinder.volume.drivers.remotefs [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0429001-f580-42a8-b019-1eca48228844 is being set with open permissions: ugo+rw Jul 07 22:19:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0429001-f580-42a8-b019-1eca48228844 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:29 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0429001-f580-42a8-b019-1eca48228844 Jul 07 22:19:29 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:29 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0429001-f580-42a8-b019-1eca48228844" returned: 0 in 0.624s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Lock "cinder-quobyte-c0429001-f580-42a8-b019-1eca48228844" released by "_copy_volume_from_snapshot" :: held 7.261s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:19:29 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Lock "cinder-quobyte-f14121d8-ee79-4e5a-9e5a-0de2c43d6743-c0429001-f580-42a8-b019-1eca48228844" released by "_create_volume_from_snapshot" :: held 7.291s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:19:29 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.307s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:19:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104db295-1a54-4880-8f1e-5007ffc20350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0429001-f580-42a8-b019-1eca48228844', 'volume_size': 1, 'snapshot_id': 'f14121d8-ee79-4e5a-9e5a-0de2c43d6743'}' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:19:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f3871b-17d8-4458-ad3b-d1a5171f6983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 22:19:30 devstack cinder-volume[87586]: INFO cinder.volume.flows.manager.create_volume [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Volume volume-c0429001-f580-42a8-b019-1eca48228844 (c0429001-f580-42a8-b019-1eca48228844): created successfully Jul 07 22:19:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f3871b-17d8-4458-ad3b-d1a5171f6983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87586) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 22:19:30 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Flow 'volume_create_manager' (20a1733e-60a5-4073-bf15-6bf7f21c640a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87586) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 22:19:30 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-ac2fd365-124f-455b-8f57-d1057f3865ce tempest-SnapshotDependencyTests-352042485 None] Created volume successfully. Jul 07 22:19:30 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-954bae00-313f-4efa-a7db-e52dddc88047 tempest-SnapshotDependencyTests-352042485 None] Acquiring lock "cinder-f14121d8-ee79-4e5a-9e5a-0de2c43d6743-delete_snapshot" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:19:30 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-954bae00-313f-4efa-a7db-e52dddc88047 tempest-SnapshotDependencyTests-352042485 None] Lock "cinder-f14121d8-ee79-4e5a-9e5a-0de2c43d6743-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:19:30 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-954bae00-313f-4efa-a7db-e52dddc88047 tempest-SnapshotDependencyTests-352042485 None] Acquiring lock "cinder-quobyte-3918315e-4d4e-40f7-87f6-30ce687b0ec8" by "delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:19:30 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-954bae00-313f-4efa-a7db-e52dddc88047 tempest-SnapshotDependencyTests-352042485 None] Lock "cinder-quobyte-3918315e-4d4e-40f7-87f6-30ce687b0ec8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:19:30 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-954bae00-313f-4efa-a7db-e52dddc88047 tempest-SnapshotDependencyTests-352042485 None] Acquiring lock "cinder-quobyte-f14121d8-ee79-4e5a-9e5a-0de2c43d6743" by "_delete_snapshot" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:19:30 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-954bae00-313f-4efa-a7db-e52dddc88047 tempest-SnapshotDependencyTests-352042485 None] Lock "cinder-quobyte-f14121d8-ee79-4e5a-9e5a-0de2c43d6743" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:19:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-954bae00-313f-4efa-a7db-e52dddc88047 tempest-SnapshotDependencyTests-352042485 None] Deleting offline snapshot f14121d8-ee79-4e5a-9e5a-0de2c43d6743 of volume 3918315e-4d4e-40f7-87f6-30ce687b0ec8 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 22:19:30 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-954bae00-313f-4efa-a7db-e52dddc88047 tempest-SnapshotDependencyTests-352042485 None] snapshot_file for this snap is: volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743 {{(pid=87586) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 22:19:30 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b2dc91-8f5c-4b45-a120-33e59ac0de2a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:19:30 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-954bae00-313f-4efa-a7db-e52dddc88047 tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:30 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743 Jul 07 22:19:30 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:31 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-954bae00-313f-4efa-a7db-e52dddc88047 tempest-SnapshotDependencyTests-352042485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743" returned: 0 in 0.718s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:31 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.remotefs [None req-954bae00-313f-4efa-a7db-e52dddc88047 tempest-SnapshotDependencyTests-352042485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87586) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 22:19:31 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb6ea6a-2275-4e13-983a-ada167b141ca]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:19:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-954bae00-313f-4efa-a7db-e52dddc88047 tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:31 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 Jul 07 22:19:31 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:31 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-954bae00-313f-4efa-a7db-e52dddc88047 tempest-SnapshotDependencyTests-352042485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8" returned: 0 in 0.728s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:31 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-954bae00-313f-4efa-a7db-e52dddc88047 tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:31 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743 Jul 07 22:19:31 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:32 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-954bae00-313f-4efa-a7db-e52dddc88047 tempest-SnapshotDependencyTests-352042485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743" returned: 0 in 0.714s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:32 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-954bae00-313f-4efa-a7db-e52dddc88047 tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:32 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743 Jul 07 22:19:32 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:33 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-954bae00-313f-4efa-a7db-e52dddc88047 tempest-SnapshotDependencyTests-352042485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8.f14121d8-ee79-4e5a-9e5a-0de2c43d6743" returned: 0 in 0.612s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-954bae00-313f-4efa-a7db-e52dddc88047 tempest-SnapshotDependencyTests-352042485 None] Lock "cinder-quobyte-f14121d8-ee79-4e5a-9e5a-0de2c43d6743" released by "_delete_snapshot" :: held 2.874s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:19:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-954bae00-313f-4efa-a7db-e52dddc88047 tempest-SnapshotDependencyTests-352042485 None] Lock "cinder-quobyte-3918315e-4d4e-40f7-87f6-30ce687b0ec8" released by "delete_snapshot" :: held 2.900s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:19:33 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-954bae00-313f-4efa-a7db-e52dddc88047 tempest-SnapshotDependencyTests-352042485 None] Created reservations ['c0d590f1-59ef-4827-b09e-d297fe69f86b', '8397298b-d3b1-4743-a03b-e88fdf412260', '5a8610ac-1b22-4f3c-8014-93959df220c5', '524a61af-ebef-4a65-a1f4-10f7cb74f102'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:19:33 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-954bae00-313f-4efa-a7db-e52dddc88047 tempest-SnapshotDependencyTests-352042485 None] Delete snapshot completed successfully. Jul 07 22:19:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-954bae00-313f-4efa-a7db-e52dddc88047 tempest-SnapshotDependencyTests-352042485 None] Lock "cinder-f14121d8-ee79-4e5a-9e5a-0de2c43d6743-delete_snapshot" released by "delete_snapshot" :: held 3.041s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:19:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-802dde92-8c66-42de-b4be-e5aa0c648209 tempest-SnapshotDependencyTests-352042485 None] Acquiring lock "cinder-3918315e-4d4e-40f7-87f6-30ce687b0ec8-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:19:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-802dde92-8c66-42de-b4be-e5aa0c648209 tempest-SnapshotDependencyTests-352042485 None] Lock "cinder-3918315e-4d4e-40f7-87f6-30ce687b0ec8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:19:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-802dde92-8c66-42de-b4be-e5aa0c648209 tempest-SnapshotDependencyTests-352042485 None] Acquiring lock "cinder-quobyte-3918315e-4d4e-40f7-87f6-30ce687b0ec8" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:19:33 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-802dde92-8c66-42de-b4be-e5aa0c648209 tempest-SnapshotDependencyTests-352042485 None] Lock "cinder-quobyte-3918315e-4d4e-40f7-87f6-30ce687b0ec8" acquired by "delete_volume" :: waited 0.015s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:19:33 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[150f0675-22e5-4a6e-ab8a-37cfbc91b62f]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:19:33 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-802dde92-8c66-42de-b4be-e5aa0c648209 tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:33 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 Jul 07 22:19:33 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:34 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-802dde92-8c66-42de-b4be-e5aa0c648209 tempest-SnapshotDependencyTests-352042485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8" returned: 0 in 0.745s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-802dde92-8c66-42de-b4be-e5aa0c648209 tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:34 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8 Jul 07 22:19:34 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:34 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:34 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-802dde92-8c66-42de-b4be-e5aa0c648209 tempest-SnapshotDependencyTests-352042485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-3918315e-4d4e-40f7-87f6-30ce687b0ec8" returned: 0 in 0.619s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:34 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-802dde92-8c66-42de-b4be-e5aa0c648209 tempest-SnapshotDependencyTests-352042485 None] Lock "cinder-quobyte-3918315e-4d4e-40f7-87f6-30ce687b0ec8" released by "delete_volume" :: held 1.423s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:19:34 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-802dde92-8c66-42de-b4be-e5aa0c648209 tempest-SnapshotDependencyTests-352042485 None] Created reservations ['cde68cb4-e904-456c-9ee6-b61736071798', 'e41cab0d-72fe-4c02-ba53-e32c7d1b1f58', '19b35a79-4759-4ae5-96c6-453d6634105c', 'af5b5464-80ff-4f1a-ac2e-5186f9dc0404'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:19:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-802dde92-8c66-42de-b4be-e5aa0c648209 tempest-SnapshotDependencyTests-352042485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:19:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-802dde92-8c66-42de-b4be-e5aa0c648209 tempest-SnapshotDependencyTests-352042485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:19:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-802dde92-8c66-42de-b4be-e5aa0c648209 tempest-SnapshotDependencyTests-352042485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:19:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-802dde92-8c66-42de-b4be-e5aa0c648209 tempest-SnapshotDependencyTests-352042485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:19:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-802dde92-8c66-42de-b4be-e5aa0c648209 tempest-SnapshotDependencyTests-352042485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:19:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-802dde92-8c66-42de-b4be-e5aa0c648209 tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:35 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:19:35 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:35 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:19:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:19:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:19:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:19:35 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:19:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:19:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:35 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-802dde92-8c66-42de-b4be-e5aa0c648209 tempest-SnapshotDependencyTests-352042485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.607s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:35 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-802dde92-8c66-42de-b4be-e5aa0c648209 tempest-SnapshotDependencyTests-352042485 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:19:35 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-802dde92-8c66-42de-b4be-e5aa0c648209 tempest-SnapshotDependencyTests-352042485 None] Deleted volume successfully. Jul 07 22:19:35 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:19:35 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-802dde92-8c66-42de-b4be-e5aa0c648209 tempest-SnapshotDependencyTests-352042485 None] Lock "cinder-3918315e-4d4e-40f7-87f6-30ce687b0ec8-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:19:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b7376c6f-0116-4b69-9425-c4cd3a8d6ee1 tempest-SnapshotDependencyTests-352042485 None] Acquiring lock "cinder-c0429001-f580-42a8-b019-1eca48228844-delete_volume" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:19:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b7376c6f-0116-4b69-9425-c4cd3a8d6ee1 tempest-SnapshotDependencyTests-352042485 None] Lock "cinder-c0429001-f580-42a8-b019-1eca48228844-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:19:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b7376c6f-0116-4b69-9425-c4cd3a8d6ee1 tempest-SnapshotDependencyTests-352042485 None] Acquiring lock "cinder-quobyte-c0429001-f580-42a8-b019-1eca48228844" by "delete_volume" {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 22:19:35 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b7376c6f-0116-4b69-9425-c4cd3a8d6ee1 tempest-SnapshotDependencyTests-352042485 None] Lock "cinder-quobyte-c0429001-f580-42a8-b019-1eca48228844" acquired by "delete_volume" :: waited 0.020s {{(pid=87586) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 22:19:35 devstack cinder-volume[87586]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9fba8c-01a7-4eae-ac8d-05f7f14e678a]: (4, 'qcow2') {{(pid=88661) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 22:19:35 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b7376c6f-0116-4b69-9425-c4cd3a8d6ee1 tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0429001-f580-42a8-b019-1eca48228844 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:35 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0429001-f580-42a8-b019-1eca48228844 Jul 07 22:19:35 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:36 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.687s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:36 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:19:36 devstack cinder-volume[87586]: DEBUG oslo_service.periodic_task [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] Running periodic task VolumeManager._thread_info {{(pid=87586) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 22:19:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread count: 28 {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5478}} Jul 07 22:19:36 devstack cinder-volume[87586]: DEBUG cinder.volume.manager [None req-c9ecc36f-b897-4a48-91af-52fe6dd7ac86 None None] thread info: [<_MainThread(MainThread, started 134145924558976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87586) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5479}} Jul 07 22:19:36 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b7376c6f-0116-4b69-9425-c4cd3a8d6ee1 tempest-SnapshotDependencyTests-352042485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0429001-f580-42a8-b019-1eca48228844" returned: 0 in 0.757s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:36 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b7376c6f-0116-4b69-9425-c4cd3a8d6ee1 tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0429001-f580-42a8-b019-1eca48228844 {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:36 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0429001-f580-42a8-b019-1eca48228844 Jul 07 22:19:36 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:37 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b7376c6f-0116-4b69-9425-c4cd3a8d6ee1 tempest-SnapshotDependencyTests-352042485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f/volume-c0429001-f580-42a8-b019-1eca48228844" returned: 0 in 0.613s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b7376c6f-0116-4b69-9425-c4cd3a8d6ee1 tempest-SnapshotDependencyTests-352042485 None] Lock "cinder-quobyte-c0429001-f580-42a8-b019-1eca48228844" released by "delete_volume" :: held 1.411s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:19:37 devstack cinder-volume[87586]: DEBUG cinder.quota [None req-b7376c6f-0116-4b69-9425-c4cd3a8d6ee1 tempest-SnapshotDependencyTests-352042485 None] Created reservations ['6d7e9c1d-35fd-43a5-8ada-bb857579ea36', '0bf5bba8-f143-422a-9656-12463cb79d35', 'e848d4cb-bb7f-4f62-942a-aee0d4eacf5e', '7dabc758-7a98-4d77-9427-44521cb1bc44'] {{(pid=87586) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 22:19:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b7376c6f-0116-4b69-9425-c4cd3a8d6ee1 tempest-SnapshotDependencyTests-352042485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 22:19:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b7376c6f-0116-4b69-9425-c4cd3a8d6ee1 tempest-SnapshotDependencyTests-352042485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 22:19:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b7376c6f-0116-4b69-9425-c4cd3a8d6ee1 tempest-SnapshotDependencyTests-352042485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491': None} {{(pid=87586) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 22:19:37 devstack cinder-volume[87586]: DEBUG cinder.volume.drivers.quobyte [None req-b7376c6f-0116-4b69-9425-c4cd3a8d6ee1 tempest-SnapshotDependencyTests-352042485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e2c64ea2-3f3c-4a80-aaa9-0e9a84c30491'] {{(pid=87586) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 22:19:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.lockutils [None req-b7376c6f-0116-4b69-9425-c4cd3a8d6ee1 tempest-SnapshotDependencyTests-352042485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87586) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 22:19:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b7376c6f-0116-4b69-9425-c4cd3a8d6ee1 tempest-SnapshotDependencyTests-352042485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 22:19:37 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f Jul 07 22:19:37 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 22:19:37 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 07 22:19:37 devstack cinder-volume[87586]: DEBUG oslo_concurrency.processutils [None req-b7376c6f-0116-4b69-9425-c4cd3a8d6ee1 tempest-SnapshotDependencyTests-352042485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1295fab96224facb45d54f1b3f1bc43f" returned: 0 in 0.612s {{(pid=87586) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 22:19:37 devstack cinder-volume[87586]: DEBUG cinder.manager [None req-b7376c6f-0116-4b69-9425-c4cd3a8d6ee1 tempest-SnapshotDependencyTests-352042485 None] Notifying Schedulers of capabilities ... {{(pid=87586) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 22:19:37 devstack cinder-volume[87586]: INFO cinder.volume.manager [None req-b7376c6f-0116-4b69-9425-c4cd3a8d6ee1 tempest-SnapshotDependencyTests-352042485 None] Deleted volume successfully. Jul 07 22:19:37 devstack cinder-volume[87586]: DEBUG cinder.coordination [None req-b7376c6f-0116-4b69-9425-c4cd3a8d6ee1 tempest-SnapshotDependencyTests-352042485 None] Lock "cinder-c0429001-f580-42a8-b019-1eca48228844-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=87586) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 22:19:47 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:UPDATE=30,cinder:SELECT=21,cinder:DELETE=3,cinder:INSERT=5 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 22:19:47 devstack cinder-volume[87586]: DEBUG dbcounter [-] [87586] Writing DB stats cinder:SELECT=27,cinder:UPDATE=27,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87586) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}